-- Logs begin at Thu 2022-08-11 10:09:08 UTC, end at Thu 2022-08-11 11:22:04 UTC. -- Aug 11 10:54:31.491549 dv-cinder-820027-17-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 11 10:54:31.500984 dv-cinder-820027-17-iscsi devstack@n-api.service[105895]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 11 10:54:31.502956 dv-cinder-820027-17-iscsi devstack@n-api.service[105895]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 11 10:54:31 2022] *** Aug 11 10:54:31.502956 dv-cinder-820027-17-iscsi devstack@n-api.service[105895]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 11 10:54:31.502956 dv-cinder-820027-17-iscsi devstack@n-api.service[105895]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 11 10:54:31.502956 dv-cinder-820027-17-iscsi devstack@n-api.service[105895]: nodename: dv-cinder-820027-17-iscsi Aug 11 10:54:31.502956 dv-cinder-820027-17-iscsi devstack@n-api.service[105895]: machine: x86_64 Aug 11 10:54:31.502956 dv-cinder-820027-17-iscsi devstack@n-api.service[105895]: clock source: unix Aug 11 10:54:31.502956 dv-cinder-820027-17-iscsi devstack@n-api.service[105895]: pcre jit disabled Aug 11 10:54:31.502956 dv-cinder-820027-17-iscsi devstack@n-api.service[105895]: detected number of CPU cores: 4 Aug 11 10:54:31.502956 dv-cinder-820027-17-iscsi devstack@n-api.service[105895]: current working directory: / Aug 11 10:54:31.502956 dv-cinder-820027-17-iscsi devstack@n-api.service[105895]: detected binary path: /usr/bin/uwsgi-core Aug 11 10:54:31.503686 dv-cinder-820027-17-iscsi devstack@n-api.service[105895]: your processes number limit is 47680 Aug 11 10:54:31.503686 dv-cinder-820027-17-iscsi devstack@n-api.service[105895]: your memory page size is 4096 bytes Aug 11 10:54:31.503686 dv-cinder-820027-17-iscsi devstack@n-api.service[105895]: detected max file descriptor number: 2048 Aug 11 10:54:31.503686 dv-cinder-820027-17-iscsi devstack@n-api.service[105895]: lock engine: pthread robust mutexes Aug 11 10:54:31.503686 dv-cinder-820027-17-iscsi devstack@n-api.service[105895]: thunder lock: enabled Aug 11 10:54:31.503686 dv-cinder-820027-17-iscsi devstack@n-api.service[105895]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 11 10:54:31.503686 dv-cinder-820027-17-iscsi devstack@n-api.service[105895]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 11 10:54:31.541679 dv-cinder-820027-17-iscsi devstack@n-api.service[105895]: Python main interpreter initialized at 0x55aad6c7f9c0 Aug 11 10:54:31.541679 dv-cinder-820027-17-iscsi devstack@n-api.service[105895]: python threads support enabled Aug 11 10:54:31.541679 dv-cinder-820027-17-iscsi devstack@n-api.service[105895]: your server socket listen backlog is limited to 100 connections Aug 11 10:54:31.541679 dv-cinder-820027-17-iscsi devstack@n-api.service[105895]: your mercy for graceful operations on workers is 90 seconds Aug 11 10:54:31.542004 dv-cinder-820027-17-iscsi devstack@n-api.service[105895]: mapped 403077 bytes (393 KB) for 2 cores Aug 11 10:54:31.542080 dv-cinder-820027-17-iscsi devstack@n-api.service[105895]: *** Operational MODE: preforking *** Aug 11 10:54:31.542824 dv-cinder-820027-17-iscsi devstack@n-api.service[105895]: *** uWSGI is running in multiple interpreter mode *** Aug 11 10:54:31.542824 dv-cinder-820027-17-iscsi devstack@n-api.service[105895]: spawned uWSGI master process (pid: 105895) Aug 11 10:54:31.543003 dv-cinder-820027-17-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 11 10:54:31.544422 dv-cinder-820027-17-iscsi devstack@n-api.service[105895]: spawned uWSGI worker 1 (pid: 105896, cores: 1) Aug 11 10:54:31.544422 dv-cinder-820027-17-iscsi devstack@n-api.service[105895]: spawned uWSGI worker 2 (pid: 105897, cores: 1) Aug 11 10:54:31.544422 dv-cinder-820027-17-iscsi devstack@n-api.service[105895]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 11 10:54:32.194533 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 11 10:54:32.195599 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 11 10:54:33.265779 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 11 10:54:33.265779 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: from cryptography.utils import int_from_bytes Aug 11 10:54:33.266419 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 11 10:54:33.266419 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: from cryptography.utils import int_from_bytes Aug 11 10:54:33.268131 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 11 10:54:33.268131 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: from cryptography.utils import int_from_bytes Aug 11 10:54:33.268570 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 11 10:54:33.268570 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: from cryptography.utils import int_from_bytes Aug 11 10:54:35.742359 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 11 10:54:35.743023 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 11 10:54:35.743389 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 11 10:54:35.743485 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 11 10:54:35.743580 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 11 10:54:35.743663 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 11 10:54:35.743754 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 11 10:54:35.743892 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 11 10:54:35.743978 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 11 10:54:35.744080 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 11 10:54:35.744172 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.744253 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.744379 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.744528 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.744694 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.744788 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.745006 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.745606 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.745862 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.745960 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.746169 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.746257 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.746483 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.746577 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.746796 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.746892 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.747113 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.747196 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.747367 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.747467 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.747673 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.747781 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.748018 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-820027-17-iscsi {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.748120 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-820027-17-iscsi {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.748332 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.748429 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.748631 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.748728 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.748932 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.749030 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.749238 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.749325 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.749546 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.749639 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.749840 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.749943 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.750135 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.750222 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.750626 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.750729 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.751803 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.751942 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.752065 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.752162 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.752256 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.752346 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.752433 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.752513 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.752591 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.752669 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.752795 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.752891 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.752973 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.753052 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.753176 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.753269 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.753436 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.753541 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.753738 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.753826 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.754120 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-820027-17-iscsi {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.754210 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-820027-17-iscsi {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.754429 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.754559 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.754731 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.754868 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.755036 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.755169 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.755433 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.755612 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.755735 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.755856 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.756061 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.756148 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.756371 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.756469 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.756681 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.756768 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.756981 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.757074 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.757295 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.757381 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.757604 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.757690 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.757912 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.757999 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.758222 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.758311 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.758514 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.758607 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.758813 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.758908 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.759110 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.759196 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.759418 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.759506 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.759713 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.759838 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.760036 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.760124 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.760279 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.760372 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.760579 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.760674 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.761433 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.761530 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.761749 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.761836 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.762063 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.762161 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.762308 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.762402 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.762550 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.762644 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.762857 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.762952 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.763172 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.763302 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.763470 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.763586 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.763785 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.763885 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.764087 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.764175 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.764386 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.764486 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.764687 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.764833 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.764971 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.765101 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.765249 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.765392 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.765552 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.765689 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.765859 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.765995 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.766161 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.766296 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.766472 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.766608 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.766771 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.766906 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.767080 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.767230 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.767463 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.767593 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.767729 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.767853 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.768025 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.768114 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.768353 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.768453 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.768661 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.768747 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.768957 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.769045 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.769265 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.769351 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.769573 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.769667 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.769872 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.769962 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.770167 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.770254 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.770467 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.770561 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.770773 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.770858 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.771098 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.771184 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.771394 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.771492 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.771636 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.771722 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.771954 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.772043 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.772254 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.772351 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.772563 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.772658 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.772859 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.772946 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.773157 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.773252 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.773454 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.773546 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.773742 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.773828 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.774038 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.774131 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.774334 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.774421 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.774630 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.774715 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.774926 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.775015 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.775221 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.775309 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.775514 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.775599 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.775831 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.775922 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.776128 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.776225 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.776448 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.776535 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.776757 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.776843 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.777066 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.777151 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.777361 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.777460 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.777658 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.777746 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.777954 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.778053 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.778251 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.778337 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.778557 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.778643 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.778852 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.778937 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.779147 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.779232 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.779456 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.779543 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.779753 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.779900 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.780068 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.780155 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.780374 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.780461 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.780670 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.780764 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.780966 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.781174 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.781264 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.781344 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.781551 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.781639 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.781847 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.781941 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.782153 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.782241 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.782451 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.782536 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.782745 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.782839 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.783038 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.783124 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.783331 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.783426 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.783623 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.783723 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.783941 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.784030 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.784237 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.784337 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.784529 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.784623 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.784817 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.784940 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.785124 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.785244 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.785433 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.785520 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.785732 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.785818 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.786030 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.786117 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.786326 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.786412 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.786633 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.786719 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 10:54:35.786954 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.787049 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.787274 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.787362 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.787605 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.787698 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.787932 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.788040 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.788256 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.788345 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.788579 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.788675 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.788887 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.788990 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.789188 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.789274 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.789491 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.789589 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.789808 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.789904 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.790108 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.790194 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.790412 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.790507 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.790713 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.790800 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.791022 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.791108 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.791329 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.791435 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.791648 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.791749 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.792002 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.792093 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.792314 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.792401 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.792624 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.792724 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.792926 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.793021 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.793233 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.793328 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.793551 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.793639 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.793861 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.793955 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.794162 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.794256 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.794490 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.794579 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.794822 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.794916 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.795126 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.795215 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.795441 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.795530 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.795750 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.795870 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.796078 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.796172 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.796380 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.796468 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.796683 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.796771 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.796997 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.797092 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.797321 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.797409 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.797625 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.797746 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.797932 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.798028 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.798234 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.798321 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.798536 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.798622 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.798835 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.798931 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.799136 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.799223 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.799438 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.799525 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.799802 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.799914 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.800088 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.800186 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.800395 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.800483 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.800698 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.800793 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.801006 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.801100 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.801312 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.801399 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.801615 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.801702 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.801918 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.802012 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.802216 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.802302 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.802513 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.802601 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.802809 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.802895 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.803111 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.803197 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.803409 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.803498 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.803718 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.803834 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.804061 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.804157 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.804362 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.804458 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.804685 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.804780 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.804982 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.805081 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.805285 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.805375 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.805591 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.805688 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.805893 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.805993 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.806191 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.806278 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.806496 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.806582 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.806800 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.806898 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.807097 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.807183 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.807410 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.807497 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.808252 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.808356 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.808553 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.808675 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.808870 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.808959 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.809169 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.809256 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.809465 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.809564 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.809770 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.809857 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.810072 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.810159 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.810375 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.810469 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.810678 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.810766 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.810981 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.811076 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.811295 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.811389 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.811600 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.811703 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.811927 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.812016 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.812259 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.812358 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.812579 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.812678 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.812876 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.812969 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.813190 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.813277 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.813505 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.813605 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.813813 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.813907 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.814109 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.814196 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.814410 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.814505 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.814706 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.814793 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.815002 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.815096 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.815296 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.815391 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.815595 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.815688 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.815913 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.816003 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.816213 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.816302 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.816507 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.816593 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.816801 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.816888 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.817095 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.817193 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.817406 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.817499 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.817704 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.817791 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.817999 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.818087 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.818293 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.818379 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.818587 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.818680 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.818921 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.819059 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.819216 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.819353 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.819544 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.819688 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.819890 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.820023 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.820198 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.820343 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.820512 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.820660 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.820816 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.820970 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.821122 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.821254 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.821423 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.821567 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.821725 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.821860 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.822028 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.822164 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.822332 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.822492 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.822634 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.822764 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.822935 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.823065 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.823292 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.823435 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.823599 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.823731 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.823942 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.824044 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.824246 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.824335 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.824557 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.824644 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.824853 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.824940 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.825159 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.825246 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.825489 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.825634 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.825810 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.825942 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.826118 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.826264 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.826428 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.826559 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.826730 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.826870 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.827036 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.827174 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.827336 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.827467 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.827639 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.827831 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.827964 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.828118 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.828263 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.828408 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.828550 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.828694 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.828829 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.828961 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.829139 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.829276 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.829439 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.829582 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.829751 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.829888 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.830050 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.830199 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.830359 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.830503 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.830637 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.830781 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.830944 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.831087 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.831261 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.831395 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.831583 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.831725 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.831904 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.832046 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.832264 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.832400 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.832540 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.832674 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.832808 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.832948 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.833096 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.833236 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.833370 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.833504 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.833648 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.834031 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.834188 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.834325 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.834461 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.834595 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.834770 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.834919 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.835075 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.835213 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.835389 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.835540 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.835672 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.835795 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.835974 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.836133 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.836268 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.836408 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.836564 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.836714 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.836849 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.836980 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.837147 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.837285 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.837458 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.837607 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.837762 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.837896 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.838074 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.838210 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.838387 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.838534 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.838667 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.839316 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.839490 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.839583 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.839825 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.839917 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.840128 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.840215 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.840426 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.840503 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.840723 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.840817 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.841018 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.841104 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.841351 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.841439 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.841655 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.841743 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.841950 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.842044 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.842260 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.842357 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.842572 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.842658 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.842874 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.842961 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.843185 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.843316 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.843486 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.843588 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.843810 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.843911 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.844130 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.844237 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.844432 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.844542 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.844733 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.844829 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.845035 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.845146 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.845337 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.845433 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.845635 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.845733 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.845938 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.846044 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.846249 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.846345 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.846550 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.846656 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.846854 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.846952 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.847154 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.847250 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.847449 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.847544 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.847747 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.847864 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.848078 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.848167 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.848634 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.848735 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.848953 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.849042 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.849260 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.849348 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.849573 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.849681 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.849881 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.849970 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.850190 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.850278 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.850512 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.850611 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.850829 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.850917 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.851161 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.851265 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.851461 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.851560 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.851795 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.851895 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.852136 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.852236 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.852389 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.852478 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.852691 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.852778 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.852989 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.853079 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.853285 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.853373 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.853581 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.853678 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.853881 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.853970 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.854175 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.854272 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.854493 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.855086 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.855328 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.855418 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.855627 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.855724 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.855963 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.856063 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.856260 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.856358 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.856565 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.856652 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.856865 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.857036 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.857178 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.857268 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.857480 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.857569 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.857776 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.857865 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.858072 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.858160 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.858366 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.858455 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.858700 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.858800 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.858994 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.859082 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.859321 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.859409 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.859640 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.859739 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.859992 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.860082 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.860291 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.860394 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.860588 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.860727 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.860900 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.860988 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.861194 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.861291 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.861487 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.861575 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.861780 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.861868 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.862079 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.862175 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.862378 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.862467 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.862670 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.862758 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.862970 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.863067 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.863270 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.863364 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.863571 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.863667 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.863893 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.863984 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.864188 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.864281 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.864487 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.864575 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.864779 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.864868 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.865084 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.865171 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.865385 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.865473 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.865677 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.865766 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.865970 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.866060 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.866268 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.866356 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.866566 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.866664 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.866863 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.866959 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.867161 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.867257 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.867453 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.867541 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.867777 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.867867 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.868075 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.868174 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.868372 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.868462 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.868667 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.868769 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.868971 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.869083 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.869267 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.869355 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.869559 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.869672 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.869872 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.869974 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.870218 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.870305 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.870514 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.870610 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.870811 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.870921 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.871109 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.871197 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.871405 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.871493 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.871700 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.871810 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.872027 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.872123 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.872341 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.872430 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.872645 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.872735 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.872941 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.873030 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.873241 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.873329 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.873537 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.873627 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.873833 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.873927 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.874129 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.874230 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.874429 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.874526 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.874725 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.874814 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.875020 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.875116 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.875313 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.875408 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.875607 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.875702 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.875923 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.876028 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.876235 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.876329 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.876534 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.876622 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.876828 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.876929 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.877124 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.877212 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.877417 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.877504 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.877748 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.877837 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.878046 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.878144 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.878392 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.878487 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.878688 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.878776 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.879048 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.879148 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.879297 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.879386 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.879599 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.879688 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.879924 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.880013 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.880229 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.880316 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.880523 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.880612 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.880827 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.880918 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.881127 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.881223 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.881428 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.881515 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.881720 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.881807 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.882017 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.882114 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.882327 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.882417 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.882629 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.882716 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.882930 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.883028 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.883239 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.883328 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.883552 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.883640 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.883890 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.883997 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.884188 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.884276 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.884488 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.884583 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.884788 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.884952 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.885089 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.885177 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.885389 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.885485 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.886201 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.886337 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.886512 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.886600 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.886815 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.886903 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.887121 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.887211 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.887425 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.887513 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.887728 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.888491 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.888491 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.889844 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.889946 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.890020 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.890112 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.890195 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.890195 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.890195 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.890195 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.890195 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.890557 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.890646 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.890783 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.890876 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.891009 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.891093 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.891174 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.891266 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.891348 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.891428 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.891515 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.891629 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.891719 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.891957 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.892048 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.892257 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.892457 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.892567 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.892768 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.892868 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.893075 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.893163 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.893377 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.893464 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.893683 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.893772 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.893989 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.894137 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.894299 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.894446 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.894608 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.894754 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.894908 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.895061 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.895315 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.895410 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.895622 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.895719 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.895954 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.896044 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.896261 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.896388 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.896557 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.896647 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.896852 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.896939 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.897147 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.897242 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.897461 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.897556 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.897758 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.897863 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.898055 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.898152 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.898352 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.898464 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.898666 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.898775 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.898967 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.899065 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.899281 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.899470 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.899691 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.899808 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.900026 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.900128 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.900328 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.900418 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.900687 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.900773 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.901001 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.901145 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.901316 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.901435 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.901656 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.901745 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.901960 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.902071 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.902274 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.902376 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.902575 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.902672 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.902882 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.902981 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.903187 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.903278 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.903482 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.903570 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.903826 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.903918 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.904134 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.904226 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.904438 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.904533 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.904735 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.904836 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.905050 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.905148 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.905364 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.905454 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.905672 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.905770 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.905985 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.906073 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.906342 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.906439 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.906644 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.906750 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.906941 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.907032 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.907248 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.907345 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.907546 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.907645 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.907875 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.907968 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.908183 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.908270 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.908480 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.908581 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.908777 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.908874 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.909077 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.909166 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.909376 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.909472 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.909674 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.909772 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.909971 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.910068 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.910270 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.910375 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.910570 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.910659 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.910866 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.910954 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.911163 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.911252 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.911487 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.911583 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.911779 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.911887 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.912094 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.912183 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.912402 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.912489 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.912709 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.912809 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.913008 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.913097 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.913302 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.913389 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.913597 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.913693 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.913904 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.913992 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.914202 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.914290 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.914501 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.914602 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.914800 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.914890 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.915131 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.915218 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.915428 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.915524 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.915743 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.915856 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.916080 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.916167 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.916393 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.916484 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.916693 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.916795 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.917540 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.917643 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.917844 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.917933 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.918141 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.918237 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.918446 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.918541 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.918743 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.918834 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.919042 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.919137 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.919337 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.919424 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.919635 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.919731 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.919957 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.920061 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.920254 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.920351 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.920549 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.920637 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.920851 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.920949 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.921147 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.921243 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.921442 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.921539 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.921739 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.921836 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.922044 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.922141 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.922339 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.922433 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.922635 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.922726 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.922947 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.923049 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.923245 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.923334 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.923544 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.923634 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.923863 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.923957 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.924188 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.924277 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.924489 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.924586 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.924797 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.924894 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.925101 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.925189 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.925407 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.925495 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.925713 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.925801 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.926018 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.926106 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.926323 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.926411 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.926624 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.926757 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.926929 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.927016 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.927235 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.927332 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.927540 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.927628 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.927865 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.928081 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.928171 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.928406 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.928498 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.928715 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.928804 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.929024 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.929268 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.929366 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.929590 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.929679 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.929900 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.929995 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.930206 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.930303 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.930507 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.930606 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.930811 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.930898 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.931112 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.931200 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.931413 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.931509 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.931718 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.931829 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.932047 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.932139 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.932350 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.932446 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.933202 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.933317 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.933522 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.933620 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.933834 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.933924 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.934141 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.934249 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.934454 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.934542 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.934763 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.934859 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.935071 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.935165 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.935384 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.935529 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.935686 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.935797 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.936020 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.936112 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.936326 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.936414 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.936630 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.936717 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.936935 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.937033 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.937240 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.937328 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.937543 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.937640 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.937845 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.937934 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.938150 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.938238 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.938460 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.938562 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.938762 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.938857 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.939065 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.939163 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.939374 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.939540 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.939684 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.939794 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.940013 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.940113 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.940324 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.940413 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.940640 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.940833 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.940946 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.941142 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.941240 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.941467 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.941555 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.941784 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.942043 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.942133 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.942352 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.942448 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.942676 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.942765 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.942993 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.943083 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.943296 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.943385 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.943593 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.943689 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.943920 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.944024 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.944225 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.944322 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.944521 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.944609 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.944821 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.944924 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.945123 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.945219 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.945421 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.945510 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.945717 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.945813 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.946020 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.946108 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.946320 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.946543 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.946633 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.946880 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.947002 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.947190 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.947280 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.947508 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.947710 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.947847 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.948073 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.948192 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.948413 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.948514 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.948733 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.948824 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.949052 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.949141 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.949362 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.949450 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.949659 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.949748 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.949967 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.950063 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.950267 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.950363 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.950563 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.950654 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.950868 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.950965 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.951170 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.951266 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.951469 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.951557 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.951811 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.951920 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.952082 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.952190 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.952383 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.952471 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.952681 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.952779 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.952979 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.953077 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.953272 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.953366 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.953577 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.953666 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.953877 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.953965 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.954173 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.954260 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.954466 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.954553 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.954764 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.954851 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.955059 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.955145 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.955352 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.955439 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.955650 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.955739 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.955971 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.956060 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.956273 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.956377 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.956567 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.956656 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.956866 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.956960 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.957161 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.957257 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.957462 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.957550 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.957759 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.957848 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.958061 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.958163 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.958365 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.958454 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.958680 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.959020 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.959232 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.959334 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.959544 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.959631 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.959879 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.959973 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.960190 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.960337 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.960505 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.960595 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.960810 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.961032 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.961130 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.961365 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.961455 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.961683 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.961772 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.962012 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.962247 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.962338 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.962576 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.962666 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.962891 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.962979 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.963211 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.963300 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.963531 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.963620 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.963872 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.963972 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.964180 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.964271 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.964483 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.964579 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.964788 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.964884 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.965095 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.965185 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.965399 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.965494 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.965704 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.965800 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.966007 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.966096 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.966309 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.966397 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.966610 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.966710 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.966914 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.967001 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.967215 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.967306 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.967518 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.967607 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.967841 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.967933 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.968148 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.968249 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.968457 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.968549 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.968761 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.968850 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.969064 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.969160 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.969370 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.969459 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.969683 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.969773 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.969989 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.970092 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.970296 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.970385 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.970600 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.970689 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.970905 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.971005 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.971204 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.971292 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.971507 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.971597 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.971831 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.971935 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.972133 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.972221 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.972438 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.972526 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.972759 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.972858 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.973065 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.973160 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.973363 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.973452 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.973730 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.973819 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.974045 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.974141 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.974363 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.974452 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.974668 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.974759 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.974969 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.975056 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.975273 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.975360 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.975587 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.975676 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.975916 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.976010 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.976234 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.976341 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.976539 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.976629 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.976834 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.976922 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.977133 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.977276 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.977429 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.977520 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.977731 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.977829 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.978042 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.978142 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.978346 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.978435 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.978642 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.978745 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.978937 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.979027 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.979238 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.979328 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.980058 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.980155 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.980358 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.980491 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.980656 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.980744 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.980951 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.981046 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.981246 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.981344 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.981539 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.981630 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.981836 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.981965 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.982129 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.982218 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.982424 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.982514 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.982718 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.982816 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.983013 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.983101 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.983310 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.983398 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.983602 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.983698 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.983923 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.984016 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.984217 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.984304 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.984513 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.984611 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.984806 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.984902 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.985102 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.985190 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.985399 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.985496 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.985696 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.985793 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.985992 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.986088 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.986315 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.986405 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.986632 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.986719 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.986935 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.987024 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.987250 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.987389 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.987557 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.987646 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.987892 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.987985 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.988198 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.988288 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.988514 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.988610 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.988815 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.988904 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.989120 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.989210 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.989424 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.989511 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.989723 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.989823 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.990025 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.990115 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.990327 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.990415 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.990628 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.990737 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.990930 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.991063 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.991234 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.991324 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.991538 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.991636 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.991873 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.991963 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.992190 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.992300 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.992486 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.992575 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.992791 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.992879 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.993099 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.993186 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.993414 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.993552 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.993727 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.993826 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.994033 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.994122 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.994335 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.994424 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.994638 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.994728 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.994941 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.995038 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.995293 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.995385 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.995600 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.995687 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.995930 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.996039 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.996238 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.996333 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.996542 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.997142 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.997280 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.997471 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.997581 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.997696 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.997787 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.997869 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.997960 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.998043 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.998124 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.998205 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.998338 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.998428 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.998655 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.998746 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.998978 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.999067 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.999291 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.999378 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.999599 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.999696 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:35.999922 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:36.000014 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:36.000163 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105897) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 11 10:54:36.000253 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:36.000562 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:36.000870 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:36.001170 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 10:54:36.001409 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105896) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 11 10:54:36.153390 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: INFO dbcounter [None req-94e37bb9-63dc-4ec9-aa09-d8b533c24f70 None None] Registered counter for database nova_api Aug 11 10:54:36.153962 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: INFO dbcounter [None req-44ed8dd2-6c4d-47c9-948b-38f30099d242 None None] Registered counter for database nova_api Aug 11 10:54:36.174428 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG oslo_db.sqlalchemy.engines [None req-94e37bb9-63dc-4ec9-aa09-d8b533c24f70 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105897) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 11 10:54:36.177957 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG oslo_db.sqlalchemy.engines [None req-44ed8dd2-6c4d-47c9-948b-38f30099d242 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105896) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 11 10:54:36.180984 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG dbcounter [-] [105897] Writer thread running {{(pid=105897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 11 10:54:36.185066 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG dbcounter [-] [105896] Writer thread running {{(pid=105896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 11 10:54:36.236607 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.context [None req-94e37bb9-63dc-4ec9-aa09-d8b533c24f70 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0(cell1) {{(pid=105897) load_cells /opt/stack/nova/nova/context.py:464}} Aug 11 10:54:36.239593 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.context [None req-44ed8dd2-6c4d-47c9-948b-38f30099d242 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0(cell1) {{(pid=105896) load_cells /opt/stack/nova/nova/context.py:464}} Aug 11 10:54:36.240446 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG oslo_concurrency.lockutils [None req-94e37bb9-63dc-4ec9-aa09-d8b533c24f70 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:54:36.240917 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG oslo_concurrency.lockutils [None req-94e37bb9-63dc-4ec9-aa09-d8b533c24f70 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:54:36.242456 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG oslo_concurrency.lockutils [None req-94e37bb9-63dc-4ec9-aa09-d8b533c24f70 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:54:36.243182 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG oslo_concurrency.lockutils [None req-94e37bb9-63dc-4ec9-aa09-d8b533c24f70 None None] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:54:36.243385 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG oslo_concurrency.lockutils [None req-44ed8dd2-6c4d-47c9-948b-38f30099d242 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:54:36.243648 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG oslo_concurrency.lockutils [None req-94e37bb9-63dc-4ec9-aa09-d8b533c24f70 None None] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:54:36.243875 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG oslo_concurrency.lockutils [None req-44ed8dd2-6c4d-47c9-948b-38f30099d242 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:54:36.245446 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG oslo_concurrency.lockutils [None req-44ed8dd2-6c4d-47c9-948b-38f30099d242 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:54:36.245648 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG oslo_concurrency.lockutils [None req-94e37bb9-63dc-4ec9-aa09-d8b533c24f70 None None] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:54:36.246172 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG oslo_concurrency.lockutils [None req-44ed8dd2-6c4d-47c9-948b-38f30099d242 None None] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 10:54:36.246629 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG oslo_concurrency.lockutils [None req-44ed8dd2-6c4d-47c9-948b-38f30099d242 None None] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 10:54:36.247608 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: INFO dbcounter [None req-94e37bb9-63dc-4ec9-aa09-d8b533c24f70 None None] Registered counter for database nova_cell0 Aug 11 10:54:36.248621 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG oslo_concurrency.lockutils [None req-44ed8dd2-6c4d-47c9-948b-38f30099d242 None None] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105896) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 10:54:36.250574 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: INFO dbcounter [None req-44ed8dd2-6c4d-47c9-948b-38f30099d242 None None] Registered counter for database nova_cell0 Aug 11 10:54:36.252936 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: INFO dbcounter [None req-94e37bb9-63dc-4ec9-aa09-d8b533c24f70 None None] Registered counter for database nova_cell1 Aug 11 10:54:36.255840 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: INFO dbcounter [None req-44ed8dd2-6c4d-47c9-948b-38f30099d242 None None] Registered counter for database nova_cell1 Aug 11 10:54:36.260187 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG oslo_db.sqlalchemy.engines [None req-94e37bb9-63dc-4ec9-aa09-d8b533c24f70 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105897) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 11 10:54:36.262053 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG oslo_db.sqlalchemy.engines [None req-94e37bb9-63dc-4ec9-aa09-d8b533c24f70 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105897) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 11 10:54:36.263907 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG oslo_db.sqlalchemy.engines [None req-44ed8dd2-6c4d-47c9-948b-38f30099d242 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105896) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 11 10:54:36.265391 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG oslo_db.sqlalchemy.engines [None req-44ed8dd2-6c4d-47c9-948b-38f30099d242 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105896) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 11 10:54:36.269111 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG dbcounter [-] [105897] Writer thread running {{(pid=105897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 11 10:54:36.270570 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG dbcounter [-] [105897] Writer thread running {{(pid=105897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 11 10:54:36.271373 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG dbcounter [-] [105896] Writer thread running {{(pid=105896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 11 10:54:36.277021 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG dbcounter [-] [105896] Writer thread running {{(pid=105896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 11 10:54:36.413589 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: INFO dbcounter [None req-94e37bb9-63dc-4ec9-aa09-d8b533c24f70 None None] Registered counter for database nova_cell0 Aug 11 10:54:36.413774 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: INFO dbcounter [None req-44ed8dd2-6c4d-47c9-948b-38f30099d242 None None] Registered counter for database nova_cell0 Aug 11 10:54:36.422778 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG oslo_db.sqlalchemy.engines [None req-94e37bb9-63dc-4ec9-aa09-d8b533c24f70 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105897) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 11 10:54:36.426171 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG oslo_db.sqlalchemy.engines [None req-44ed8dd2-6c4d-47c9-948b-38f30099d242 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105896) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 11 10:54:36.427258 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG dbcounter [-] [105897] Writer thread running {{(pid=105897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 11 10:54:36.430541 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG dbcounter [-] [105896] Writer thread running {{(pid=105896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 11 10:54:36.844780 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: WARNING keystonemiddleware.auth_token [None req-94e37bb9-63dc-4ec9-aa09-d8b533c24f70 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 11 10:54:36.852064 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: WARNING keystonemiddleware.auth_token [None req-94e37bb9-63dc-4ec9-aa09-d8b533c24f70 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 11 10:54:36.878675 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: WARNING keystonemiddleware.auth_token [None req-44ed8dd2-6c4d-47c9-948b-38f30099d242 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 11 10:54:36.886006 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: WARNING keystonemiddleware.auth_token [None req-44ed8dd2-6c4d-47c9-948b-38f30099d242 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 11 10:54:37.193412 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: WARNING keystonemiddleware.auth_token [None req-94e37bb9-63dc-4ec9-aa09-d8b533c24f70 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 11 10:54:37.200051 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: WARNING keystonemiddleware.auth_token [None req-94e37bb9-63dc-4ec9-aa09-d8b533c24f70 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 11 10:54:37.205379 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55aad6c7f9c0 pid: 105897 (default app) Aug 11 10:54:37.207503 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-94e37bb9-63dc-4ec9-aa09-d8b533c24f70 None None] Calling method '>' {{(pid=105897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:54:37.208954 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: INFO nova.api.openstack.requestlog [None req-94e37bb9-63dc-4ec9-aa09-d8b533c24f70 None None] 10.222.0.48 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001789 Aug 11 10:54:37.209376 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: [pid: 105897|app: 0|req: 1/1] 10.222.0.48 () {50 vars in 788 bytes} [Thu Aug 11 10:54:37 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:54:37.245726 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: WARNING keystonemiddleware.auth_token [None req-44ed8dd2-6c4d-47c9-948b-38f30099d242 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 11 10:54:37.251649 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: WARNING keystonemiddleware.auth_token [None req-44ed8dd2-6c4d-47c9-948b-38f30099d242 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 11 10:54:37.256900 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55aad6c7f9c0 pid: 105896 (default app) Aug 11 10:55:56.287024 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-94e37bb9-63dc-4ec9-aa09-d8b533c24f70 None None] Calling method '>' {{(pid=105897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:55:56.287998 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: INFO nova.api.openstack.requestlog [None req-94e37bb9-63dc-4ec9-aa09-d8b533c24f70 None None] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Aug 11 10:55:56.288669 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: [pid: 105897|app: 0|req: 2/2] 10.222.0.48 () {54 vars in 931 bytes} [Thu Aug 11 10:55:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:55:56.300552 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG dbcounter [-] [105896] Writing DB stats nova_api:SELECT=3 {{(pid=105896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:55:56.302042 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG dbcounter [-] [105896] Writing DB stats nova_cell0:SELECT=3 {{(pid=105896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:55:56.303044 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG dbcounter [-] [105896] Writing DB stats nova_cell1:SELECT=3 {{(pid=105896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:55:56.304035 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG dbcounter [-] [105896] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:55:57.149817 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi [None req-62ef8a12-a2d9-4bf8-abfa-3244c5d1bd83 admin admin] Calling method '>' {{(pid=105896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:55:57.181412 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: INFO nova.api.openstack.requestlog [None req-62ef8a12-a2d9-4bf8-abfa-3244c5d1bd83 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.886043 Aug 11 10:55:57.182302 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: [pid: 105896|app: 0|req: 1/3] 10.222.0.48 () {60 vars in 1292 bytes} [Thu Aug 11 10:55:56 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:55:59.363847 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-94e37bb9-63dc-4ec9-aa09-d8b533c24f70 None None] Calling method '>' {{(pid=105897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:55:59.364860 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: INFO nova.api.openstack.requestlog [None req-94e37bb9-63dc-4ec9-aa09-d8b533c24f70 None None] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Aug 11 10:55:59.365269 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: [pid: 105897|app: 0|req: 3/4] 10.222.0.48 () {54 vars in 931 bytes} [Thu Aug 11 10:55:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:55:59.828379 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi [None req-24058ea2-b8f9-4861-ab23-734e206372be admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "ram": 256, "name": "cirros256", "os-flavor-access:is_public": true, "disk": 1, "swap": 0, "id": "c1", "rxtx_factor": 1.0}} {{(pid=105896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:55:59.852647 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 11 10:55:59.852647 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: warnings.warn(msg) Aug 11 10:55:59.941052 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: INFO nova.api.openstack.requestlog [None req-24058ea2-b8f9-4861-ab23-734e206372be admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.569644 Aug 11 10:55:59.942399 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: [pid: 105896|app: 0|req: 2/5] 10.222.0.48 () {64 vars in 1283 bytes} [Thu Aug 11 10:55:59 2022] POST /compute/v2.1/flavors => generated 407 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 10:56:00.168844 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-7b252673-ffc7-47f5-ad11-e7541e60ac0d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:56:00.173226 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 11 10:56:00.173226 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: warnings.warn(msg) Aug 11 10:56:00.175911 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG dbcounter [-] [105897] Writing DB stats nova_api:SELECT=3 {{(pid=105897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:56:00.177244 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG dbcounter [-] [105897] Writing DB stats nova_cell1:SELECT=3 {{(pid=105897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:56:00.178163 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG dbcounter [-] [105897] Writing DB stats nova_cell0:SELECT=3 {{(pid=105897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:56:00.179063 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG dbcounter [-] [105897] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:56:00.302890 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: INFO nova.api.openstack.requestlog [None req-7b252673-ffc7-47f5-ad11-e7541e60ac0d admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.352174 Aug 11 10:56:00.303819 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: [pid: 105897|app: 0|req: 4/6] 10.222.0.48 () {64 vars in 1336 bytes} [Thu Aug 11 10:55:59 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:56:02.522595 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi [None req-24058ea2-b8f9-4861-ab23-734e206372be admin admin] Calling method '>' {{(pid=105896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:56:02.523612 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: INFO nova.api.openstack.requestlog [None req-24058ea2-b8f9-4861-ab23-734e206372be admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Aug 11 10:56:02.524204 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: [pid: 105896|app: 0|req: 3/7] 10.222.0.48 () {54 vars in 931 bytes} [Thu Aug 11 10:56:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:56:03.192736 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-3a07c893-44c0-40af-b55a-a488612fc146 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "d1", "os-flavor-access:is_public": true, "ram": 512, "name": "ds512M", "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0}} {{(pid=105897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:56:03.211924 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 11 10:56:03.211924 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: warnings.warn(msg) Aug 11 10:56:03.329386 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: INFO nova.api.openstack.requestlog [None req-3a07c893-44c0-40af-b55a-a488612fc146 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.799338 Aug 11 10:56:03.330415 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: [pid: 105897|app: 0|req: 5/8] 10.222.0.48 () {64 vars in 1283 bytes} [Thu Aug 11 10:56:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 10:56:03.342635 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi [None req-c4ffea39-ec93-44f0-ae51-e9daa5263e60 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:56:03.345460 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 11 10:56:03.345460 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: warnings.warn(msg) Aug 11 10:56:03.458246 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: INFO nova.api.openstack.requestlog [None req-c4ffea39-ec93-44f0-ae51-e9daa5263e60 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.119467 Aug 11 10:56:03.459174 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: [pid: 105896|app: 0|req: 4/9] 10.222.0.48 () {64 vars in 1336 bytes} [Thu Aug 11 10:56:03 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:56:05.643060 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-3a07c893-44c0-40af-b55a-a488612fc146 admin admin] Calling method '>' {{(pid=105897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:56:05.644218 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: INFO nova.api.openstack.requestlog [None req-3a07c893-44c0-40af-b55a-a488612fc146 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Aug 11 10:56:05.659436 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: [pid: 105897|app: 0|req: 6/10] 10.222.0.48 () {54 vars in 931 bytes} [Thu Aug 11 10:56:05 2022] GET /compute/v2.1 => generated 388 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:56:06.053059 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi [None req-7029b369-fe45-4a33-bf23-ac796a949fb4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "id": "d2", "rxtx_factor": 1.0, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "name": "ds1G", "swap": 0, "os-flavor-access:is_public": true}} {{(pid=105896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:56:06.142166 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: INFO nova.api.openstack.requestlog [None req-7029b369-fe45-4a33-bf23-ac796a949fb4 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.491828 Aug 11 10:56:06.142721 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: [pid: 105896|app: 0|req: 5/11] 10.222.0.48 () {64 vars in 1283 bytes} [Thu Aug 11 10:56:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 10:56:06.154526 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-5111c919-e299-4699-adbd-59de013099ac admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:56:06.233383 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: INFO nova.api.openstack.requestlog [None req-5111c919-e299-4699-adbd-59de013099ac admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.082496 Aug 11 10:56:06.233934 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: [pid: 105897|app: 0|req: 7/12] 10.222.0.48 () {64 vars in 1336 bytes} [Thu Aug 11 10:56:06 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:56:08.401437 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi [None req-7029b369-fe45-4a33-bf23-ac796a949fb4 admin admin] Calling method '>' {{(pid=105896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:56:08.404817 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: INFO nova.api.openstack.requestlog [None req-7029b369-fe45-4a33-bf23-ac796a949fb4 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Aug 11 10:56:08.404817 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: [pid: 105896|app: 0|req: 6/13] 10.222.0.48 () {54 vars in 931 bytes} [Thu Aug 11 10:56:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:56:08.830028 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-3763cb8b-2777-4d0a-8404-5dc3487d3ec5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "disk": 10, "rxtx_factor": 1.0, "id": "d3", "ram": 2048, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 2}} {{(pid=105897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:56:08.938290 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: INFO nova.api.openstack.requestlog [None req-3763cb8b-2777-4d0a-8404-5dc3487d3ec5 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.526392 Aug 11 10:56:08.939070 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: [pid: 105897|app: 0|req: 8/14] 10.222.0.48 () {64 vars in 1283 bytes} [Thu Aug 11 10:56:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 10:56:08.951346 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi [None req-2a523a7d-074d-4112-8347-5cb34b929c2f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:56:09.036776 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: INFO nova.api.openstack.requestlog [None req-2a523a7d-074d-4112-8347-5cb34b929c2f admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.089054 Aug 11 10:56:09.038602 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: [pid: 105896|app: 0|req: 7/15] 10.222.0.48 () {64 vars in 1336 bytes} [Thu Aug 11 10:56:08 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:56:11.349595 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-3763cb8b-2777-4d0a-8404-5dc3487d3ec5 admin admin] Calling method '>' {{(pid=105897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:56:11.350689 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: INFO nova.api.openstack.requestlog [None req-3763cb8b-2777-4d0a-8404-5dc3487d3ec5 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001402 Aug 11 10:56:11.355375 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: [pid: 105897|app: 0|req: 9/16] 10.222.0.48 () {54 vars in 931 bytes} [Thu Aug 11 10:56:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:56:11.778720 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi [None req-ea47934e-ae83-4d35-b58c-83ae5f1ba546 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "name": "ds4G", "ram": 4096, "os-flavor-access:is_public": true, "id": "d4", "swap": 0, "rxtx_factor": 1.0, "vcpus": 4}} {{(pid=105896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:56:11.869421 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: INFO nova.api.openstack.requestlog [None req-ea47934e-ae83-4d35-b58c-83ae5f1ba546 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.512563 Aug 11 10:56:11.870718 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: [pid: 105896|app: 0|req: 8/17] 10.222.0.48 () {64 vars in 1283 bytes} [Thu Aug 11 10:56:11 2022] POST /compute/v2.1/flavors => generated 404 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 10:56:11.883029 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-ee1f33db-77cd-4312-badc-5a0c41388acb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:56:12.043661 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: INFO nova.api.openstack.requestlog [None req-ee1f33db-77cd-4312-badc-5a0c41388acb admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.165064 Aug 11 10:56:12.056161 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: [pid: 105897|app: 0|req: 10/18] 10.222.0.48 () {64 vars in 1336 bytes} [Thu Aug 11 10:56:11 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:56:14.249399 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi [None req-ea47934e-ae83-4d35-b58c-83ae5f1ba546 admin admin] Calling method '>' {{(pid=105896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:56:14.250421 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: INFO nova.api.openstack.requestlog [None req-ea47934e-ae83-4d35-b58c-83ae5f1ba546 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Aug 11 10:56:14.250829 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: [pid: 105896|app: 0|req: 9/19] 10.222.0.48 () {54 vars in 931 bytes} [Thu Aug 11 10:56:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:56:14.671689 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-0e6d3f46-4696-4c91-8b78-2e97d5703cc5 admin admin] Calling method '>' {{(pid=105897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:56:14.702789 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: INFO nova.api.openstack.requestlog [None req-0e6d3f46-4696-4c91-8b78-2e97d5703cc5 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.444988 Aug 11 10:56:14.703719 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: [pid: 105897|app: 0|req: 11/20] 10.222.0.48 () {60 vars in 1292 bytes} [Thu Aug 11 10:56:14 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:56:17.356656 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi [None req-ea47934e-ae83-4d35-b58c-83ae5f1ba546 admin admin] Calling method '>' {{(pid=105896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:56:17.357692 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: INFO nova.api.openstack.requestlog [None req-ea47934e-ae83-4d35-b58c-83ae5f1ba546 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Aug 11 10:56:17.358044 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: [pid: 105896|app: 0|req: 10/21] 10.222.0.48 () {54 vars in 931 bytes} [Thu Aug 11 10:56:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:56:17.774834 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-280dd56a-77eb-446f-900b-1a2be21dfa04 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 512, "rxtx_factor": 1.0, "disk": 1, "id": "1", "swap": 0, "name": "m1.tiny"}} {{(pid=105897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:56:17.848546 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: INFO nova.api.openstack.requestlog [None req-280dd56a-77eb-446f-900b-1a2be21dfa04 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.483846 Aug 11 10:56:17.849103 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: [pid: 105897|app: 0|req: 12/22] 10.222.0.48 () {64 vars in 1283 bytes} [Thu Aug 11 10:56:17 2022] POST /compute/v2.1/flavors => generated 402 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 10:56:17.861617 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi [None req-397e5c1e-ded9-4427-9e7e-956da5151720 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:56:17.944677 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: INFO nova.api.openstack.requestlog [None req-397e5c1e-ded9-4427-9e7e-956da5151720 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086941 Aug 11 10:56:17.945325 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: [pid: 105896|app: 0|req: 11/23] 10.222.0.48 () {64 vars in 1333 bytes} [Thu Aug 11 10:56:17 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:56:20.191086 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-280dd56a-77eb-446f-900b-1a2be21dfa04 admin admin] Calling method '>' {{(pid=105897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:56:20.192159 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: INFO nova.api.openstack.requestlog [None req-280dd56a-77eb-446f-900b-1a2be21dfa04 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002048 Aug 11 10:56:20.192605 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: [pid: 105897|app: 0|req: 13/24] 10.222.0.48 () {54 vars in 931 bytes} [Thu Aug 11 10:56:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:56:20.589769 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi [None req-dcb81204-810d-403f-8f88-14f136064fcb admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 20, "swap": 0, "id": "2", "os-flavor-access:is_public": true, "name": "m1.small", "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=105896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:56:20.667543 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: INFO nova.api.openstack.requestlog [None req-dcb81204-810d-403f-8f88-14f136064fcb admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.469046 Aug 11 10:56:20.668320 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: [pid: 105896|app: 0|req: 12/25] 10.222.0.48 () {64 vars in 1283 bytes} [Thu Aug 11 10:56:20 2022] POST /compute/v2.1/flavors => generated 405 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 10:56:20.680786 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-8e24a416-1f09-4596-a216-b139676840d1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:56:20.868409 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: INFO nova.api.openstack.requestlog [None req-8e24a416-1f09-4596-a216-b139676840d1 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.191233 Aug 11 10:56:20.868903 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: [pid: 105897|app: 0|req: 14/26] 10.222.0.48 () {64 vars in 1333 bytes} [Thu Aug 11 10:56:20 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:56:23.063350 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi [None req-dcb81204-810d-403f-8f88-14f136064fcb admin admin] Calling method '>' {{(pid=105896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:56:23.069105 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: INFO nova.api.openstack.requestlog [None req-dcb81204-810d-403f-8f88-14f136064fcb admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Aug 11 10:56:23.069105 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: [pid: 105896|app: 0|req: 13/27] 10.222.0.48 () {54 vars in 931 bytes} [Thu Aug 11 10:56:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:56:23.486180 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-36e1be0c-0da7-418e-b685-021bfde47a61 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "name": "m1.medium", "id": "3", "vcpus": 2, "swap": 0, "ram": 4096, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:56:23.582229 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: INFO nova.api.openstack.requestlog [None req-36e1be0c-0da7-418e-b685-021bfde47a61 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.511225 Aug 11 10:56:23.582817 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: [pid: 105897|app: 0|req: 15/28] 10.222.0.48 () {64 vars in 1283 bytes} [Thu Aug 11 10:56:23 2022] POST /compute/v2.1/flavors => generated 406 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 10:56:23.595403 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi [None req-00bc4ccb-62e1-485c-bc4d-415e4cacf8a6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:56:23.706102 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: INFO nova.api.openstack.requestlog [None req-00bc4ccb-62e1-485c-bc4d-415e4cacf8a6 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.114666 Aug 11 10:56:23.706757 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: [pid: 105896|app: 0|req: 14/29] 10.222.0.48 () {64 vars in 1333 bytes} [Thu Aug 11 10:56:23 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:56:26.043235 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-36e1be0c-0da7-418e-b685-021bfde47a61 admin admin] Calling method '>' {{(pid=105897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:56:26.044492 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: INFO nova.api.openstack.requestlog [None req-36e1be0c-0da7-418e-b685-021bfde47a61 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001730 Aug 11 10:56:26.044892 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: [pid: 105897|app: 0|req: 16/30] 10.222.0.48 () {54 vars in 931 bytes} [Thu Aug 11 10:56:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:56:26.477588 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi [None req-9222e8c3-4ff1-4ac6-8913-664cadd3d856 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "rxtx_factor": 1.0, "disk": 80, "id": "4", "name": "m1.large"}} {{(pid=105896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:56:26.538535 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG dbcounter [-] [105896] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:56:26.544285 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: INFO nova.api.openstack.requestlog [None req-9222e8c3-4ff1-4ac6-8913-664cadd3d856 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.493188 Aug 11 10:56:26.544829 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: [pid: 105896|app: 0|req: 15/31] 10.222.0.48 () {64 vars in 1283 bytes} [Thu Aug 11 10:56:26 2022] POST /compute/v2.1/flavors => generated 405 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 10:56:26.562999 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-a0cd80be-660e-4331-b0b6-d9e7c36d4a2a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:56:26.635268 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: INFO nova.api.openstack.requestlog [None req-a0cd80be-660e-4331-b0b6-d9e7c36d4a2a admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.081549 Aug 11 10:56:26.636236 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: [pid: 105897|app: 0|req: 17/32] 10.222.0.48 () {64 vars in 1333 bytes} [Thu Aug 11 10:56:26 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:56:28.897708 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi [None req-9222e8c3-4ff1-4ac6-8913-664cadd3d856 admin admin] Calling method '>' {{(pid=105896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:56:28.898712 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: INFO nova.api.openstack.requestlog [None req-9222e8c3-4ff1-4ac6-8913-664cadd3d856 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Aug 11 10:56:28.904142 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: [pid: 105896|app: 0|req: 16/33] 10.222.0.48 () {54 vars in 931 bytes} [Thu Aug 11 10:56:28 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:56:29.343391 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-bd9fa720-a9a5-4bf3-b093-5cf1efecca2e admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "vcpus": 8, "swap": 0, "name": "m1.xlarge", "os-flavor-access:is_public": true, "ram": 16384}} {{(pid=105897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:56:29.433349 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: INFO nova.api.openstack.requestlog [None req-bd9fa720-a9a5-4bf3-b093-5cf1efecca2e admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.527896 Aug 11 10:56:29.434063 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: [pid: 105897|app: 0|req: 18/34] 10.222.0.48 () {64 vars in 1283 bytes} [Thu Aug 11 10:56:28 2022] POST /compute/v2.1/flavors => generated 408 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 10:56:29.446272 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi [None req-851ae1c4-4e1f-410d-87cb-77fed828dcca admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:56:29.562188 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: INFO nova.api.openstack.requestlog [None req-851ae1c4-4e1f-410d-87cb-77fed828dcca admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.119748 Aug 11 10:56:29.563025 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: [pid: 105896|app: 0|req: 17/35] 10.222.0.48 () {64 vars in 1333 bytes} [Thu Aug 11 10:56:29 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:56:50.908698 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-bd9fa720-a9a5-4bf3-b093-5cf1efecca2e admin admin] Calling method '>' {{(pid=105897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:56:50.909726 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: INFO nova.api.openstack.requestlog [None req-bd9fa720-a9a5-4bf3-b093-5cf1efecca2e admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Aug 11 10:56:50.910149 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: [pid: 105897|app: 0|req: 19/36] 10.222.0.48 () {54 vars in 931 bytes} [Thu Aug 11 10:56:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:56:51.290768 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi [None req-36ee3c7a-fd69-40ba-ba80-888792bb655c admin admin] Calling method '>' {{(pid=105896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:56:51.308544 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: INFO nova.api.openstack.requestlog [None req-36ee3c7a-fd69-40ba-ba80-888792bb655c admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.392340 Aug 11 10:56:51.309073 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: [pid: 105896|app: 0|req: 18/37] 10.222.0.48 () {60 vars in 1292 bytes} [Thu Aug 11 10:56:50 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 10:56:52.354047 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-bd9fa720-a9a5-4bf3-b093-5cf1efecca2e admin admin] Calling method '>' {{(pid=105897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:56:52.355046 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: INFO nova.api.openstack.requestlog [None req-bd9fa720-a9a5-4bf3-b093-5cf1efecca2e admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Aug 11 10:56:52.355447 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: [pid: 105897|app: 0|req: 20/38] 10.222.0.48 () {56 vars in 1074 bytes} [Thu Aug 11 10:56:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:56:52.866874 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi [None req-669d31ed-13d2-4111-8eea-352f660bf858 admin admin] Calling method '>' {{(pid=105896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:56:52.872359 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: INFO nova.api.openstack.wsgi [None req-669d31ed-13d2-4111-8eea-352f660bf858 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 11 10:56:52.875627 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi [None req-669d31ed-13d2-4111-8eea-352f660bf858 admin admin] Request method failure captured: Aug 11 10:56:52.875627 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 11 10:56:52.875627 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: Accept: application/json Aug 11 10:56:52.875627 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: Accept-Encoding: gzip, deflate Aug 11 10:56:52.875627 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: Connection: keep-alive Aug 11 10:56:52.875627 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: Content-Length: 0 Aug 11 10:56:52.875627 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: Host: 10.222.0.48 Aug 11 10:56:52.875627 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: Openstack-Api-Version: compute 2.90 Aug 11 10:56:52.875627 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: Openstack-System-Scope: None Aug 11 10:56:52.875627 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: User-Agent: python-novaclient Aug 11 10:56:52.875627 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: X-Auth-Token: gAAAAABi9OB0Q1WhNrnPBsfr4RYMgfjQuUWaewMioUoM80J-JTGQ3VV2ZJzsCoWWLIGDIIFyLhzbIA78T32QXPQDel04US3fIKwlJocgbUuggezEafCABc2kyxYZb-VayTjmv29BUbd1E0IT7EsJfHRhAdnep5l80BLayix34qvN5m0yKeRtcWg Aug 11 10:56:52.875627 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: X-Domain-Id: None Aug 11 10:56:52.875627 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: X-Domain-Name: None Aug 11 10:56:52.875627 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: X-Identity-Status: Confirmed Aug 11 10:56:52.875627 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: X-Is-Admin-Project: True Aug 11 10:56:52.875627 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: X-Openstack-Nova-Api-Version: 2.90 Aug 11 10:56:52.875627 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: X-Project-Domain-Id: default Aug 11 10:56:52.875627 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: X-Project-Domain-Name: Default Aug 11 10:56:52.875627 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: X-Project-Id: 345ef69aeca14be9ac484aeebec744ed Aug 11 10:56:52.875627 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: X-Project-Name: admin Aug 11 10:56:52.875627 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: X-Role: admin,reader,member Aug 11 10:56:52.875627 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: X-Roles: admin,reader,member Aug 11 10:56:52.877206 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/345ef69aeca14be9ac484aeebec744ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/345ef69aeca14be9ac484aeebec744ed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/345ef69aeca14be9ac484aeebec744ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_345ef69aeca14be9ac484aeebec744ed", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] Aug 11 10:56:52.877206 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: X-Tenant: admin Aug 11 10:56:52.877206 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: X-Tenant-Id: 345ef69aeca14be9ac484aeebec744ed Aug 11 10:56:52.877206 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: X-Tenant-Name: admin Aug 11 10:56:52.877206 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: X-User: admin Aug 11 10:56:52.877206 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: X-User-Domain-Id: default Aug 11 10:56:52.877206 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: X-User-Domain-Name: Default Aug 11 10:56:52.877206 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: X-User-Id: 697f0ea802614a91b28dfb28d2104fff Aug 11 10:56:52.877206 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: X-User-Name: admin Aug 11 10:56:52.877206 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: method: > Aug 11 10:56:52.877206 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: exception: Flavor 42 could not be found. Aug 11 10:56:52.877206 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: action_args: {'id': '42'} Aug 11 10:56:52.877206 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: {{(pid=105896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 10:56:52.877206 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:56:52.878165 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 11 10:56:52.878165 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 11 10:56:52.878165 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 11 10:56:52.878165 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 11 10:56:52.878165 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 11 10:56:52.878165 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 11 10:56:52.878165 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 11 10:56:52.878165 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 11 10:56:52.878165 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 11 10:56:52.878165 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 10:56:52.878165 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 11 10:56:52.878165 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 11 10:56:52.878165 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 11 10:56:52.878165 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi Aug 11 10:56:52.878165 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:56:52.878165 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi Aug 11 10:56:52.878165 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:56:52.878165 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:56:52.878165 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:56:52.879590 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 10:56:52.879590 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 10:56:52.879590 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 10:56:52.879590 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 10:56:52.879590 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 11 10:56:52.879590 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 11 10:56:52.879590 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 11 10:56:52.879590 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi Aug 11 10:56:52.879590 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:56:52.879590 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi Aug 11 10:56:52.879590 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:56:52.879590 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:56:52.879590 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:56:52.879590 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 10:56:52.879590 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 10:56:52.879590 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 11 10:56:52.879590 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi Aug 11 10:56:52.879590 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi [None req-669d31ed-13d2-4111-8eea-352f660bf858 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 10:56:52.881018 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: INFO nova.api.openstack.requestlog [None req-669d31ed-13d2-4111-8eea-352f660bf858 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.384619 Aug 11 10:56:52.881018 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: [pid: 105896|app: 0|req: 19/39] 10.222.0.48 () {60 vars in 1190 bytes} [Thu Aug 11 10:56:52 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 386 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 11 10:56:52.886590 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-ec1f00a3-b447-468b-9014-d2a717274a15 admin admin] Calling method '>' {{(pid=105897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:56:52.891164 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG dbcounter [-] [105897] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=105897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:56:52.910024 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: INFO nova.api.openstack.requestlog [None req-ec1f00a3-b447-468b-9014-d2a717274a15 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026989 Aug 11 10:56:52.910559 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: [pid: 105897|app: 0|req: 21/40] 10.222.0.48 () {60 vars in 1210 bytes} [Thu Aug 11 10:56:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:56:52.920210 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi [None req-7ef86d2b-3ac9-400f-9ece-0c60a51937a7 admin admin] Calling method '>' {{(pid=105896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:56:52.944657 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: INFO nova.api.openstack.requestlog [None req-7ef86d2b-3ac9-400f-9ece-0c60a51937a7 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028124 Aug 11 10:56:52.945179 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: [pid: 105896|app: 0|req: 20/41] 10.222.0.48 () {60 vars in 1210 bytes} [Thu Aug 11 10:56:52 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:56:52.954311 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-c951496e-1413-40cd-b1cd-23439beae51e admin admin] Calling method '>' {{(pid=105897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:56:52.960461 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: INFO nova.api.openstack.wsgi [None req-c951496e-1413-40cd-b1cd-23439beae51e admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 11 10:56:52.963672 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-c951496e-1413-40cd-b1cd-23439beae51e admin admin] Request method failure captured: Aug 11 10:56:52.963672 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 11 10:56:52.963672 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: Accept: application/json Aug 11 10:56:52.963672 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: Accept-Encoding: gzip, deflate Aug 11 10:56:52.963672 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: Connection: keep-alive Aug 11 10:56:52.963672 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: Content-Length: 0 Aug 11 10:56:52.963672 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: Host: 10.222.0.48 Aug 11 10:56:52.963672 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: Openstack-Api-Version: compute 2.90 Aug 11 10:56:52.963672 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: Openstack-System-Scope: None Aug 11 10:56:52.963672 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: User-Agent: python-novaclient Aug 11 10:56:52.963672 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: X-Auth-Token: gAAAAABi9OB0Q1WhNrnPBsfr4RYMgfjQuUWaewMioUoM80J-JTGQ3VV2ZJzsCoWWLIGDIIFyLhzbIA78T32QXPQDel04US3fIKwlJocgbUuggezEafCABc2kyxYZb-VayTjmv29BUbd1E0IT7EsJfHRhAdnep5l80BLayix34qvN5m0yKeRtcWg Aug 11 10:56:52.963672 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: X-Domain-Id: None Aug 11 10:56:52.963672 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: X-Domain-Name: None Aug 11 10:56:52.963672 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: X-Identity-Status: Confirmed Aug 11 10:56:52.963672 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: X-Is-Admin-Project: True Aug 11 10:56:52.963672 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: X-Openstack-Nova-Api-Version: 2.90 Aug 11 10:56:52.963672 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: X-Project-Domain-Id: default Aug 11 10:56:52.963672 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: X-Project-Domain-Name: Default Aug 11 10:56:52.963672 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: X-Project-Id: 345ef69aeca14be9ac484aeebec744ed Aug 11 10:56:52.963672 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: X-Project-Name: admin Aug 11 10:56:52.963672 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: X-Role: admin,reader,member Aug 11 10:56:52.963672 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: X-Roles: admin,reader,member Aug 11 10:56:52.965055 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/345ef69aeca14be9ac484aeebec744ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/345ef69aeca14be9ac484aeebec744ed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/345ef69aeca14be9ac484aeebec744ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_345ef69aeca14be9ac484aeebec744ed", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] Aug 11 10:56:52.965055 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: X-Tenant: admin Aug 11 10:56:52.965055 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: X-Tenant-Id: 345ef69aeca14be9ac484aeebec744ed Aug 11 10:56:52.965055 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: X-Tenant-Name: admin Aug 11 10:56:52.965055 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: X-User: admin Aug 11 10:56:52.965055 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: X-User-Domain-Id: default Aug 11 10:56:52.965055 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: X-User-Domain-Name: Default Aug 11 10:56:52.965055 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: X-User-Id: 697f0ea802614a91b28dfb28d2104fff Aug 11 10:56:52.965055 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: X-User-Name: admin Aug 11 10:56:52.965055 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: method: > Aug 11 10:56:52.965055 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: exception: Flavor 42 could not be found. Aug 11 10:56:52.965055 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: action_args: {'id': '42'} Aug 11 10:56:52.965055 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: {{(pid=105897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 10:56:52.965055 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:56:52.965873 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 11 10:56:52.965873 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 11 10:56:52.965873 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 11 10:56:52.965873 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 11 10:56:52.965873 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 11 10:56:52.965873 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 11 10:56:52.965873 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 11 10:56:52.965873 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 11 10:56:52.965873 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 11 10:56:52.965873 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 10:56:52.965873 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 11 10:56:52.965873 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 11 10:56:52.965873 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 11 10:56:52.965873 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi Aug 11 10:56:52.965873 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:56:52.965873 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi Aug 11 10:56:52.965873 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:56:52.965873 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:56:52.965873 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:56:52.967023 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 10:56:52.967023 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 10:56:52.967023 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 10:56:52.967023 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 10:56:52.967023 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 11 10:56:52.967023 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 11 10:56:52.967023 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 11 10:56:52.967023 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi Aug 11 10:56:52.967023 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:56:52.967023 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi Aug 11 10:56:52.967023 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:56:52.967023 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:56:52.967023 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:56:52.967023 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 10:56:52.967023 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 10:56:52.967023 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 11 10:56:52.967023 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi Aug 11 10:56:52.967023 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-c951496e-1413-40cd-b1cd-23439beae51e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 10:56:52.968334 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: INFO nova.api.openstack.requestlog [None req-c951496e-1413-40cd-b1cd-23439beae51e admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014303 Aug 11 10:56:52.968334 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: [pid: 105897|app: 0|req: 22/42] 10.222.0.48 () {60 vars in 1190 bytes} [Thu Aug 11 10:56:52 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 11 10:56:53.936357 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi [None req-7ef86d2b-3ac9-400f-9ece-0c60a51937a7 admin admin] Calling method '>' {{(pid=105896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:56:53.937906 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: INFO nova.api.openstack.requestlog [None req-7ef86d2b-3ac9-400f-9ece-0c60a51937a7 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Aug 11 10:56:53.938291 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: [pid: 105896|app: 0|req: 21/43] 10.222.0.48 () {56 vars in 1074 bytes} [Thu Aug 11 10:56:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:56:54.455608 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-b95d0c8c-b344-4076-b5c0-f93a4f3aa8a2 admin admin] Calling method '>' {{(pid=105897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:56:54.460921 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: INFO nova.api.openstack.wsgi [None req-b95d0c8c-b344-4076-b5c0-f93a4f3aa8a2 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 11 10:56:54.462413 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-b95d0c8c-b344-4076-b5c0-f93a4f3aa8a2 admin admin] Request method failure captured: Aug 11 10:56:54.462413 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 11 10:56:54.462413 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: Accept: application/json Aug 11 10:56:54.462413 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: Accept-Encoding: gzip, deflate Aug 11 10:56:54.462413 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: Connection: keep-alive Aug 11 10:56:54.462413 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: Content-Length: 0 Aug 11 10:56:54.462413 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: Host: 10.222.0.48 Aug 11 10:56:54.462413 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: Openstack-Api-Version: compute 2.90 Aug 11 10:56:54.462413 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: Openstack-System-Scope: None Aug 11 10:56:54.462413 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: User-Agent: python-novaclient Aug 11 10:56:54.462413 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: X-Auth-Token: gAAAAABi9OB1jfYXeYbqSSdDiQ61JHvkkAM5EQsC4FbDO8sILZECuEpucfO9h95qhfPlrLIUkT9BTP6UjS70pVESTB8590wUmO9Ka7oYB0o5gTd_qWcyYntd38r5swaO3HKM18Z_Dcb4fCCK8a_420zp0APT8TR8g3Fa_6St20RN9uZV-NZzKXE Aug 11 10:56:54.462413 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: X-Domain-Id: None Aug 11 10:56:54.462413 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: X-Domain-Name: None Aug 11 10:56:54.462413 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: X-Identity-Status: Confirmed Aug 11 10:56:54.462413 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: X-Is-Admin-Project: True Aug 11 10:56:54.462413 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: X-Openstack-Nova-Api-Version: 2.90 Aug 11 10:56:54.462413 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: X-Project-Domain-Id: default Aug 11 10:56:54.462413 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: X-Project-Domain-Name: Default Aug 11 10:56:54.462413 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: X-Project-Id: 345ef69aeca14be9ac484aeebec744ed Aug 11 10:56:54.462413 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: X-Project-Name: admin Aug 11 10:56:54.462413 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: X-Role: admin,reader,member Aug 11 10:56:54.462413 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: X-Roles: admin,reader,member Aug 11 10:56:54.463998 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/345ef69aeca14be9ac484aeebec744ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/345ef69aeca14be9ac484aeebec744ed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/345ef69aeca14be9ac484aeebec744ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_345ef69aeca14be9ac484aeebec744ed", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] Aug 11 10:56:54.463998 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: X-Tenant: admin Aug 11 10:56:54.463998 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: X-Tenant-Id: 345ef69aeca14be9ac484aeebec744ed Aug 11 10:56:54.463998 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: X-Tenant-Name: admin Aug 11 10:56:54.463998 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: X-User: admin Aug 11 10:56:54.463998 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: X-User-Domain-Id: default Aug 11 10:56:54.463998 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: X-User-Domain-Name: Default Aug 11 10:56:54.463998 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: X-User-Id: 697f0ea802614a91b28dfb28d2104fff Aug 11 10:56:54.463998 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: X-User-Name: admin Aug 11 10:56:54.463998 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: method: > Aug 11 10:56:54.463998 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: exception: Flavor 84 could not be found. Aug 11 10:56:54.463998 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: action_args: {'id': '84'} Aug 11 10:56:54.463998 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: {{(pid=105897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 10:56:54.463998 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:56:54.464974 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 11 10:56:54.464974 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 11 10:56:54.464974 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 11 10:56:54.464974 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 11 10:56:54.464974 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 11 10:56:54.464974 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 11 10:56:54.464974 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 11 10:56:54.464974 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 11 10:56:54.464974 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 11 10:56:54.464974 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 10:56:54.464974 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 11 10:56:54.464974 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 11 10:56:54.464974 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 11 10:56:54.464974 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi Aug 11 10:56:54.464974 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:56:54.464974 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi Aug 11 10:56:54.464974 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:56:54.464974 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:56:54.464974 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:56:54.466460 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 10:56:54.466460 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 10:56:54.466460 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 10:56:54.466460 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 10:56:54.466460 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 11 10:56:54.466460 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 11 10:56:54.466460 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 11 10:56:54.466460 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi Aug 11 10:56:54.466460 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:56:54.466460 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi Aug 11 10:56:54.466460 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:56:54.466460 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:56:54.466460 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:56:54.466460 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 10:56:54.466460 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 10:56:54.466460 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 11 10:56:54.466460 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi Aug 11 10:56:54.466460 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-b95d0c8c-b344-4076-b5c0-f93a4f3aa8a2 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 10:56:54.467782 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: INFO nova.api.openstack.requestlog [None req-b95d0c8c-b344-4076-b5c0-f93a4f3aa8a2 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.382840 Aug 11 10:56:54.467782 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: [pid: 105897|app: 0|req: 23/44] 10.222.0.48 () {60 vars in 1190 bytes} [Thu Aug 11 10:56:54 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 384 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 11 10:56:54.473485 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi [None req-23b15704-45d6-42f7-9cd2-f0849de6fcaf admin admin] Calling method '>' {{(pid=105896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:56:54.488827 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: INFO nova.api.openstack.requestlog [None req-23b15704-45d6-42f7-9cd2-f0849de6fcaf admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018905 Aug 11 10:56:54.489348 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: [pid: 105896|app: 0|req: 22/45] 10.222.0.48 () {60 vars in 1210 bytes} [Thu Aug 11 10:56:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:56:54.498585 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-efdc548d-2b00-4eb7-bbe9-453cc6144ad1 admin admin] Calling method '>' {{(pid=105897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:56:54.515536 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: INFO nova.api.openstack.requestlog [None req-efdc548d-2b00-4eb7-bbe9-453cc6144ad1 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020461 Aug 11 10:56:54.516094 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: [pid: 105897|app: 0|req: 24/46] 10.222.0.48 () {60 vars in 1210 bytes} [Thu Aug 11 10:56:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:56:54.525065 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi [None req-04e7e20b-45c1-463c-80d9-a177fe3af565 admin admin] Calling method '>' {{(pid=105896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:56:54.530233 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: INFO nova.api.openstack.wsgi [None req-04e7e20b-45c1-463c-80d9-a177fe3af565 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 11 10:56:54.531710 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi [None req-04e7e20b-45c1-463c-80d9-a177fe3af565 admin admin] Request method failure captured: Aug 11 10:56:54.531710 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 11 10:56:54.531710 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: Accept: application/json Aug 11 10:56:54.531710 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: Accept-Encoding: gzip, deflate Aug 11 10:56:54.531710 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: Connection: keep-alive Aug 11 10:56:54.531710 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: Content-Length: 0 Aug 11 10:56:54.531710 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: Host: 10.222.0.48 Aug 11 10:56:54.531710 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: Openstack-Api-Version: compute 2.90 Aug 11 10:56:54.531710 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: Openstack-System-Scope: None Aug 11 10:56:54.531710 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: User-Agent: python-novaclient Aug 11 10:56:54.531710 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: X-Auth-Token: gAAAAABi9OB1jfYXeYbqSSdDiQ61JHvkkAM5EQsC4FbDO8sILZECuEpucfO9h95qhfPlrLIUkT9BTP6UjS70pVESTB8590wUmO9Ka7oYB0o5gTd_qWcyYntd38r5swaO3HKM18Z_Dcb4fCCK8a_420zp0APT8TR8g3Fa_6St20RN9uZV-NZzKXE Aug 11 10:56:54.531710 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: X-Domain-Id: None Aug 11 10:56:54.531710 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: X-Domain-Name: None Aug 11 10:56:54.531710 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: X-Identity-Status: Confirmed Aug 11 10:56:54.531710 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: X-Is-Admin-Project: True Aug 11 10:56:54.531710 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: X-Openstack-Nova-Api-Version: 2.90 Aug 11 10:56:54.531710 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: X-Project-Domain-Id: default Aug 11 10:56:54.531710 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: X-Project-Domain-Name: Default Aug 11 10:56:54.531710 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: X-Project-Id: 345ef69aeca14be9ac484aeebec744ed Aug 11 10:56:54.531710 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: X-Project-Name: admin Aug 11 10:56:54.531710 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: X-Role: admin,reader,member Aug 11 10:56:54.531710 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: X-Roles: admin,reader,member Aug 11 10:56:54.533334 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/345ef69aeca14be9ac484aeebec744ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/345ef69aeca14be9ac484aeebec744ed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/345ef69aeca14be9ac484aeebec744ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_345ef69aeca14be9ac484aeebec744ed", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] Aug 11 10:56:54.533334 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: X-Tenant: admin Aug 11 10:56:54.533334 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: X-Tenant-Id: 345ef69aeca14be9ac484aeebec744ed Aug 11 10:56:54.533334 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: X-Tenant-Name: admin Aug 11 10:56:54.533334 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: X-User: admin Aug 11 10:56:54.533334 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: X-User-Domain-Id: default Aug 11 10:56:54.533334 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: X-User-Domain-Name: Default Aug 11 10:56:54.533334 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: X-User-Id: 697f0ea802614a91b28dfb28d2104fff Aug 11 10:56:54.533334 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: X-User-Name: admin Aug 11 10:56:54.533334 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: method: > Aug 11 10:56:54.533334 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: exception: Flavor 84 could not be found. Aug 11 10:56:54.533334 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: action_args: {'id': '84'} Aug 11 10:56:54.533334 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: {{(pid=105896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 10:56:54.533334 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:56:54.534376 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 11 10:56:54.534376 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 11 10:56:54.534376 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 11 10:56:54.534376 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 11 10:56:54.534376 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 11 10:56:54.534376 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 11 10:56:54.534376 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 11 10:56:54.534376 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 11 10:56:54.534376 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 11 10:56:54.534376 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 10:56:54.534376 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 11 10:56:54.534376 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 11 10:56:54.534376 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 11 10:56:54.534376 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi Aug 11 10:56:54.534376 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:56:54.534376 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi Aug 11 10:56:54.534376 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:56:54.534376 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:56:54.534376 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:56:54.535785 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 10:56:54.535785 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 10:56:54.535785 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 10:56:54.535785 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 10:56:54.535785 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 11 10:56:54.535785 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 11 10:56:54.535785 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 11 10:56:54.535785 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi Aug 11 10:56:54.535785 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:56:54.535785 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi Aug 11 10:56:54.535785 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:56:54.535785 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:56:54.535785 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:56:54.535785 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 10:56:54.535785 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 10:56:54.535785 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 11 10:56:54.535785 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi Aug 11 10:56:54.535785 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi [None req-04e7e20b-45c1-463c-80d9-a177fe3af565 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 10:56:54.537047 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: INFO nova.api.openstack.requestlog [None req-04e7e20b-45c1-463c-80d9-a177fe3af565 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011472 Aug 11 10:56:54.537047 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: [pid: 105896|app: 0|req: 23/47] 10.222.0.48 () {60 vars in 1190 bytes} [Thu Aug 11 10:56:54 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 11 10:56:55.518632 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-efdc548d-2b00-4eb7-bbe9-453cc6144ad1 admin admin] Calling method '>' {{(pid=105897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:56:55.519638 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: INFO nova.api.openstack.requestlog [None req-efdc548d-2b00-4eb7-bbe9-453cc6144ad1 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Aug 11 10:56:55.520063 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: [pid: 105897|app: 0|req: 25/48] 10.222.0.48 () {56 vars in 1074 bytes} [Thu Aug 11 10:56:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:56:56.038581 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi [None req-2d2e4860-33f5-4733-b04f-f8d31f978334 admin admin] Calling method '>' {{(pid=105896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:56:56.044581 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: INFO nova.api.openstack.wsgi [None req-2d2e4860-33f5-4733-b04f-f8d31f978334 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 11 10:56:56.046050 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi [None req-2d2e4860-33f5-4733-b04f-f8d31f978334 admin admin] Request method failure captured: Aug 11 10:56:56.046050 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 11 10:56:56.046050 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: Accept: application/json Aug 11 10:56:56.046050 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: Accept-Encoding: gzip, deflate Aug 11 10:56:56.046050 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: Connection: keep-alive Aug 11 10:56:56.046050 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: Content-Length: 0 Aug 11 10:56:56.046050 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: Host: 10.222.0.48 Aug 11 10:56:56.046050 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: Openstack-Api-Version: compute 2.90 Aug 11 10:56:56.046050 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: Openstack-System-Scope: None Aug 11 10:56:56.046050 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: User-Agent: python-novaclient Aug 11 10:56:56.046050 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: X-Auth-Token: gAAAAABi9OB3Hsx8t3w9EHb793734OgzeQUv6flwhYIYXnbzaGQx1H_jgDCvRhmG8ztDDlc7uwzV09zDozRAwLhyapWbUIXE0Ogt7eDTZqEVLXJ91Wmnq1uFM1JvqHzdH45yGyVQaa2aKE7ewhvCxY83HPL-702CbwPrGMbhGDfRsHtd_fyJR1U Aug 11 10:56:56.046050 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: X-Domain-Id: None Aug 11 10:56:56.046050 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: X-Domain-Name: None Aug 11 10:56:56.046050 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: X-Identity-Status: Confirmed Aug 11 10:56:56.046050 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: X-Is-Admin-Project: True Aug 11 10:56:56.046050 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: X-Openstack-Nova-Api-Version: 2.90 Aug 11 10:56:56.046050 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: X-Project-Domain-Id: default Aug 11 10:56:56.046050 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: X-Project-Domain-Name: Default Aug 11 10:56:56.046050 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: X-Project-Id: 345ef69aeca14be9ac484aeebec744ed Aug 11 10:56:56.046050 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: X-Project-Name: admin Aug 11 10:56:56.046050 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: X-Role: admin,reader,member Aug 11 10:56:56.046050 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: X-Roles: admin,reader,member Aug 11 10:56:56.047514 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/345ef69aeca14be9ac484aeebec744ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/345ef69aeca14be9ac484aeebec744ed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/345ef69aeca14be9ac484aeebec744ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_345ef69aeca14be9ac484aeebec744ed", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] Aug 11 10:56:56.047514 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: X-Tenant: admin Aug 11 10:56:56.047514 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: X-Tenant-Id: 345ef69aeca14be9ac484aeebec744ed Aug 11 10:56:56.047514 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: X-Tenant-Name: admin Aug 11 10:56:56.047514 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: X-User: admin Aug 11 10:56:56.047514 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: X-User-Domain-Id: default Aug 11 10:56:56.047514 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: X-User-Domain-Name: Default Aug 11 10:56:56.047514 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: X-User-Id: 697f0ea802614a91b28dfb28d2104fff Aug 11 10:56:56.047514 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: X-User-Name: admin Aug 11 10:56:56.047514 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: method: > Aug 11 10:56:56.047514 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: exception: Flavor 451 could not be found. Aug 11 10:56:56.047514 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: action_args: {'id': '451'} Aug 11 10:56:56.047514 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: {{(pid=105896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 10:56:56.047514 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:56:56.048552 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 11 10:56:56.048552 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 11 10:56:56.048552 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 11 10:56:56.048552 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 11 10:56:56.048552 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 11 10:56:56.048552 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 11 10:56:56.048552 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 11 10:56:56.048552 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 11 10:56:56.048552 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 11 10:56:56.048552 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 10:56:56.048552 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 11 10:56:56.048552 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 11 10:56:56.048552 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 11 10:56:56.048552 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi Aug 11 10:56:56.048552 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:56:56.048552 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi Aug 11 10:56:56.048552 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:56:56.048552 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:56:56.048552 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:56:56.050188 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 10:56:56.050188 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 10:56:56.050188 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 10:56:56.050188 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 10:56:56.050188 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 11 10:56:56.050188 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 11 10:56:56.050188 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 11 10:56:56.050188 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi Aug 11 10:56:56.050188 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:56:56.050188 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi Aug 11 10:56:56.050188 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:56:56.050188 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:56:56.050188 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:56:56.050188 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 10:56:56.050188 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 10:56:56.050188 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 11 10:56:56.050188 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: ERROR nova.api.openstack.wsgi Aug 11 10:56:56.050188 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi [None req-2d2e4860-33f5-4733-b04f-f8d31f978334 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105896) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 10:56:56.051549 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: INFO nova.api.openstack.requestlog [None req-2d2e4860-33f5-4733-b04f-f8d31f978334 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.389173 Aug 11 10:56:56.051549 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: [pid: 105896|app: 0|req: 24/49] 10.222.0.48 () {60 vars in 1193 bytes} [Thu Aug 11 10:56:55 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 11 10:56:56.057105 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-85088427-723c-4bcd-9ed0-969620677e25 admin admin] Calling method '>' {{(pid=105897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:56:56.071829 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: INFO nova.api.openstack.requestlog [None req-85088427-723c-4bcd-9ed0-969620677e25 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018274 Aug 11 10:56:56.072349 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: [pid: 105897|app: 0|req: 26/50] 10.222.0.48 () {60 vars in 1210 bytes} [Thu Aug 11 10:56:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 10:56:56.082372 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi [None req-358daf9f-dfd8-4c07-92c3-e3ec380d9d84 admin admin] Calling method '>' {{(pid=105896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:56:56.100636 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: INFO nova.api.openstack.requestlog [None req-358daf9f-dfd8-4c07-92c3-e3ec380d9d84 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.021938 Aug 11 10:56:56.101198 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: [pid: 105896|app: 0|req: 25/51] 10.222.0.48 () {60 vars in 1210 bytes} [Thu Aug 11 10:56:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:56:56.113241 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-8c890faa-9fe2-4d20-bf4c-ce6d10657d5d admin admin] Calling method '>' {{(pid=105897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:56:56.118683 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: INFO nova.api.openstack.wsgi [None req-8c890faa-9fe2-4d20-bf4c-ce6d10657d5d admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 11 10:56:56.120223 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-8c890faa-9fe2-4d20-bf4c-ce6d10657d5d admin admin] Request method failure captured: Aug 11 10:56:56.120223 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 11 10:56:56.120223 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: Accept: application/json Aug 11 10:56:56.120223 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: Accept-Encoding: gzip, deflate Aug 11 10:56:56.120223 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: Connection: keep-alive Aug 11 10:56:56.120223 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: Content-Length: 0 Aug 11 10:56:56.120223 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: Host: 10.222.0.48 Aug 11 10:56:56.120223 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: Openstack-Api-Version: compute 2.90 Aug 11 10:56:56.120223 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: Openstack-System-Scope: None Aug 11 10:56:56.120223 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: User-Agent: python-novaclient Aug 11 10:56:56.120223 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: X-Auth-Token: gAAAAABi9OB3Hsx8t3w9EHb793734OgzeQUv6flwhYIYXnbzaGQx1H_jgDCvRhmG8ztDDlc7uwzV09zDozRAwLhyapWbUIXE0Ogt7eDTZqEVLXJ91Wmnq1uFM1JvqHzdH45yGyVQaa2aKE7ewhvCxY83HPL-702CbwPrGMbhGDfRsHtd_fyJR1U Aug 11 10:56:56.120223 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: X-Domain-Id: None Aug 11 10:56:56.120223 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: X-Domain-Name: None Aug 11 10:56:56.120223 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: X-Identity-Status: Confirmed Aug 11 10:56:56.120223 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: X-Is-Admin-Project: True Aug 11 10:56:56.120223 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: X-Openstack-Nova-Api-Version: 2.90 Aug 11 10:56:56.120223 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: X-Project-Domain-Id: default Aug 11 10:56:56.120223 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: X-Project-Domain-Name: Default Aug 11 10:56:56.120223 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: X-Project-Id: 345ef69aeca14be9ac484aeebec744ed Aug 11 10:56:56.120223 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: X-Project-Name: admin Aug 11 10:56:56.120223 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: X-Role: admin,reader,member Aug 11 10:56:56.120223 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: X-Roles: admin,reader,member Aug 11 10:56:56.121769 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/345ef69aeca14be9ac484aeebec744ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/345ef69aeca14be9ac484aeebec744ed"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/345ef69aeca14be9ac484aeebec744ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_345ef69aeca14be9ac484aeebec744ed", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] Aug 11 10:56:56.121769 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: X-Tenant: admin Aug 11 10:56:56.121769 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: X-Tenant-Id: 345ef69aeca14be9ac484aeebec744ed Aug 11 10:56:56.121769 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: X-Tenant-Name: admin Aug 11 10:56:56.121769 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: X-User: admin Aug 11 10:56:56.121769 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: X-User-Domain-Id: default Aug 11 10:56:56.121769 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: X-User-Domain-Name: Default Aug 11 10:56:56.121769 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: X-User-Id: 697f0ea802614a91b28dfb28d2104fff Aug 11 10:56:56.121769 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: X-User-Name: admin Aug 11 10:56:56.121769 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: method: > Aug 11 10:56:56.121769 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: exception: Flavor 451 could not be found. Aug 11 10:56:56.121769 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: action_args: {'id': '451'} Aug 11 10:56:56.121769 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: {{(pid=105897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 10:56:56.121769 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:56:56.122828 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 11 10:56:56.122828 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 11 10:56:56.122828 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 11 10:56:56.122828 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 11 10:56:56.122828 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 11 10:56:56.122828 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 11 10:56:56.122828 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 11 10:56:56.122828 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 11 10:56:56.122828 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 11 10:56:56.122828 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 10:56:56.122828 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 11 10:56:56.122828 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 11 10:56:56.122828 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 11 10:56:56.122828 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi Aug 11 10:56:56.122828 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:56:56.122828 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi Aug 11 10:56:56.122828 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:56:56.122828 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:56:56.122828 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:56:56.124991 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 10:56:56.124991 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 10:56:56.124991 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 10:56:56.124991 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 10:56:56.124991 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 11 10:56:56.124991 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 11 10:56:56.124991 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 11 10:56:56.124991 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi Aug 11 10:56:56.124991 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 10:56:56.124991 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi Aug 11 10:56:56.124991 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 10:56:56.124991 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 10:56:56.124991 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 10:56:56.124991 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 10:56:56.124991 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 10:56:56.124991 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 11 10:56:56.124991 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: ERROR nova.api.openstack.wsgi Aug 11 10:56:56.124991 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-8c890faa-9fe2-4d20-bf4c-ce6d10657d5d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105897) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 10:56:56.126263 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: INFO nova.api.openstack.requestlog [None req-8c890faa-9fe2-4d20-bf4c-ce6d10657d5d admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.013444 Aug 11 10:56:56.126263 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: [pid: 105897|app: 0|req: 27/52] 10.222.0.48 () {60 vars in 1193 bytes} [Thu Aug 11 10:56:56 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 11 10:56:57.087636 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi [None req-358daf9f-dfd8-4c07-92c3-e3ec380d9d84 admin admin] Calling method '>' {{(pid=105896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:56:57.088690 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: INFO nova.api.openstack.requestlog [None req-358daf9f-dfd8-4c07-92c3-e3ec380d9d84 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001527 Aug 11 10:56:57.089081 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: [pid: 105896|app: 0|req: 26/53] 10.222.0.48 () {56 vars in 1074 bytes} [Thu Aug 11 10:56:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 10:56:57.600778 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-afb06f64-9827-4886-8a00-8725ed0b9586 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:56:57.690022 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: INFO nova.api.openstack.requestlog [None req-afb06f64-9827-4886-8a00-8725ed0b9586 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.465076 Aug 11 10:56:57.690566 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: [pid: 105897|app: 0|req: 28/54] 10.222.0.48 () {64 vars in 1235 bytes} [Thu Aug 11 10:56:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 10:56:58.663121 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi [None req-358daf9f-dfd8-4c07-92c3-e3ec380d9d84 admin admin] Calling method '>' {{(pid=105896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:56:58.664184 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: INFO nova.api.openstack.requestlog [None req-358daf9f-dfd8-4c07-92c3-e3ec380d9d84 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Aug 11 10:56:58.664576 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: [pid: 105896|app: 0|req: 27/55] 10.222.0.48 () {56 vars in 1074 bytes} [Thu Aug 11 10:56:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:56:59.176275 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-167ca08c-b96b-4df1-8a06-b81679c400be admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:56:59.260663 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: INFO nova.api.openstack.requestlog [None req-167ca08c-b96b-4df1-8a06-b81679c400be admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.457413 Aug 11 10:56:59.261205 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: [pid: 105897|app: 0|req: 29/56] 10.222.0.48 () {64 vars in 1235 bytes} [Thu Aug 11 10:56:58 2022] POST /compute/v2.1/flavors => generated 405 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 10:57:00.217864 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi [None req-358daf9f-dfd8-4c07-92c3-e3ec380d9d84 admin admin] Calling method '>' {{(pid=105896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:57:00.218872 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: INFO nova.api.openstack.requestlog [None req-358daf9f-dfd8-4c07-92c3-e3ec380d9d84 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Aug 11 10:57:00.220208 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: [pid: 105896|app: 0|req: 28/57] 10.222.0.48 () {56 vars in 1074 bytes} [Thu Aug 11 10:57:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:57:00.730267 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-d4f7df78-60a5-4623-9342-f7f7dec020da admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:57:00.812036 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: INFO nova.api.openstack.requestlog [None req-d4f7df78-60a5-4623-9342-f7f7dec020da admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.455979 Aug 11 10:57:00.812626 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: [pid: 105897|app: 0|req: 30/58] 10.222.0.48 () {64 vars in 1235 bytes} [Thu Aug 11 10:57:00 2022] POST /compute/v2.1/flavors => generated 407 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 10:57:01.776617 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi [None req-358daf9f-dfd8-4c07-92c3-e3ec380d9d84 admin admin] Calling method '>' {{(pid=105896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:57:01.777659 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: INFO nova.api.openstack.requestlog [None req-358daf9f-dfd8-4c07-92c3-e3ec380d9d84 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Aug 11 10:57:01.778047 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: [pid: 105896|app: 0|req: 29/59] 10.222.0.48 () {56 vars in 1074 bytes} [Thu Aug 11 10:57:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:57:02.297569 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-32fbd96a-7a42-41d3-949f-42a92ee0d8d7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 10:57:02.438436 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: INFO nova.api.openstack.requestlog [None req-32fbd96a-7a42-41d3-949f-42a92ee0d8d7 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.518711 Aug 11 10:57:02.446064 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: [pid: 105897|app: 0|req: 31/60] 10.222.0.48 () {64 vars in 1235 bytes} [Thu Aug 11 10:57:01 2022] POST /compute/v2.1/flavors => generated 409 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 10:57:03.400811 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi [None req-358daf9f-dfd8-4c07-92c3-e3ec380d9d84 admin admin] Calling method '>' {{(pid=105896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:57:03.401814 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: INFO nova.api.openstack.requestlog [None req-358daf9f-dfd8-4c07-92c3-e3ec380d9d84 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 Aug 11 10:57:03.402209 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: [pid: 105896|app: 0|req: 30/61] 10.222.0.48 () {56 vars in 1074 bytes} [Thu Aug 11 10:57:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:57:03.916982 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-924f5e53-0181-472e-af10-6850a6d9f26e admin admin] Calling method '>' {{(pid=105897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:57:03.937666 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: INFO nova.api.openstack.requestlog [None req-924f5e53-0181-472e-af10-6850a6d9f26e admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.398464 Aug 11 10:57:03.938819 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: [pid: 105897|app: 0|req: 32/62] 10.222.0.48 () {60 vars in 1202 bytes} [Thu Aug 11 10:57:03 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 10:57:54.987642 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi [None req-358daf9f-dfd8-4c07-92c3-e3ec380d9d84 admin admin] Calling method '>' {{(pid=105896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:57:54.988667 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: INFO nova.api.openstack.requestlog [None req-358daf9f-dfd8-4c07-92c3-e3ec380d9d84 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Aug 11 10:57:54.989055 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: [pid: 105896|app: 0|req: 31/63] 10.222.0.48 () {54 vars in 931 bytes} [Thu Aug 11 10:57:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 10:57:54.999369 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG dbcounter [-] [105897] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:57:55.369766 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-cfb38514-d691-4f5a-96de-01f6aaeb2580 admin admin] Calling method '>' {{(pid=105897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:57:55.390650 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: INFO nova.api.openstack.requestlog [None req-cfb38514-d691-4f5a-96de-01f6aaeb2580 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.395792 Aug 11 10:57:55.391176 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: [pid: 105897|app: 0|req: 33/64] 10.222.0.48 () {60 vars in 1292 bytes} [Thu Aug 11 10:57:54 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 10:57:55.414124 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi [None req-452576b9-d7b2-4acb-91a7-6491514e70f4 admin admin] Calling method '>' {{(pid=105896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:57:55.417526 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG dbcounter [-] [105896] Writing DB stats nova_api:SELECT=21,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=105896) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 10:57:55.422387 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: INFO nova.api.openstack.requestlog [None req-452576b9-d7b2-4acb-91a7-6491514e70f4 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011955 Aug 11 10:57:55.422900 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: [pid: 105896|app: 0|req: 32/65] 10.222.0.48 () {60 vars in 1283 bytes} [Thu Aug 11 10:57:55 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:57:55.434391 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-55608fec-11cc-426e-8307-16bdd5e3605f admin admin] Calling method '>' {{(pid=105897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:57:55.441927 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: INFO nova.api.openstack.requestlog [None req-55608fec-11cc-426e-8307-16bdd5e3605f admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011451 Aug 11 10:57:55.442445 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: [pid: 105897|app: 0|req: 34/66] 10.222.0.48 () {60 vars in 1286 bytes} [Thu Aug 11 10:57:55 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:57:55.454281 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi [None req-10ba146a-76e0-47d9-88d4-7054604ad28e admin admin] Calling method '>' {{(pid=105896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:57:55.461916 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: INFO nova.api.openstack.requestlog [None req-10ba146a-76e0-47d9-88d4-7054604ad28e admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011289 Aug 11 10:57:55.462430 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: [pid: 105896|app: 0|req: 33/67] 10.222.0.48 () {60 vars in 1286 bytes} [Thu Aug 11 10:57:55 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 10:57:55.474623 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-a60593ba-6ab4-40e8-a96f-4f0f7bcff7f7 admin admin] Calling method '>' {{(pid=105897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 10:57:55.482190 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: INFO nova.api.openstack.requestlog [None req-a60593ba-6ab4-40e8-a96f-4f0f7bcff7f7 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011119 Aug 11 10:57:55.482725 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: [pid: 105897|app: 0|req: 35/68] 10.222.0.48 () {60 vars in 1283 bytes} [Thu Aug 11 10:57:55 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:01:42.572711 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi [None req-10ba146a-76e0-47d9-88d4-7054604ad28e admin admin] Calling method '>' {{(pid=105896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:01:42.573727 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: INFO nova.api.openstack.requestlog [None req-10ba146a-76e0-47d9-88d4-7054604ad28e admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Aug 11 11:01:42.574119 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: [pid: 105896|app: 0|req: 34/69] 10.222.0.48 () {56 vars in 1074 bytes} [Thu Aug 11 11:01:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:01:42.718552 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG dbcounter [-] [105897] Writing DB stats nova_api:SELECT=6 {{(pid=105897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:01:42.851023 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-bab9bff1-72d2-4d29-9b7a-5f7ba3934977 admin admin] Calling method '>' {{(pid=105897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:01:42.853423 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 11 11:01:42.853423 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: warnings.warn(msg) Aug 11 11:01:42.854572 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG oslo_concurrency.lockutils [None req-bab9bff1-72d2-4d29-9b7a-5f7ba3934977 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:01:42.855049 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG oslo_concurrency.lockutils [None req-bab9bff1-72d2-4d29-9b7a-5f7ba3934977 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:01:42.855479 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG oslo_concurrency.lockutils [None req-bab9bff1-72d2-4d29-9b7a-5f7ba3934977 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:01:42.856219 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG oslo_concurrency.lockutils [None req-bab9bff1-72d2-4d29-9b7a-5f7ba3934977 admin admin] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:01:42.856671 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG oslo_concurrency.lockutils [None req-bab9bff1-72d2-4d29-9b7a-5f7ba3934977 admin admin] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:01:42.857090 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG oslo_concurrency.lockutils [None req-bab9bff1-72d2-4d29-9b7a-5f7ba3934977 admin admin] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:01:42.891553 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: INFO nova.api.openstack.requestlog [None req-bab9bff1-72d2-4d29-9b7a-5f7ba3934977 admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.177882 Aug 11 11:01:42.892137 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: [pid: 105897|app: 0|req: 36/70] 10.222.0.48 () {60 vars in 1193 bytes} [Thu Aug 11 11:01:42 2022] GET /compute/v2.1/os-services => generated 794 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 11:01:43.722749 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi [None req-10ba146a-76e0-47d9-88d4-7054604ad28e admin admin] Calling method '>' {{(pid=105896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:01:43.723879 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: INFO nova.api.openstack.requestlog [None req-10ba146a-76e0-47d9-88d4-7054604ad28e admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Aug 11 11:01:43.724296 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: [pid: 105896|app: 0|req: 35/71] 10.222.0.48 () {56 vars in 1074 bytes} [Thu Aug 11 11:01:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:01:43.918498 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-379079e2-cedc-4ec7-8836-32b4bd5376e7 admin admin] Calling method '>' {{(pid=105897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:01:43.920862 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 11 11:01:43.920862 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: warnings.warn(msg) Aug 11 11:01:43.921959 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG oslo_concurrency.lockutils [None req-379079e2-cedc-4ec7-8836-32b4bd5376e7 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:01:43.922428 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG oslo_concurrency.lockutils [None req-379079e2-cedc-4ec7-8836-32b4bd5376e7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:01:43.922850 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG oslo_concurrency.lockutils [None req-379079e2-cedc-4ec7-8836-32b4bd5376e7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:01:43.924406 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG oslo_concurrency.lockutils [None req-379079e2-cedc-4ec7-8836-32b4bd5376e7 admin admin] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:01:43.924608 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG oslo_concurrency.lockutils [None req-379079e2-cedc-4ec7-8836-32b4bd5376e7 admin admin] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:01:43.924994 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG oslo_concurrency.lockutils [None req-379079e2-cedc-4ec7-8836-32b4bd5376e7 admin admin] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:01:43.944425 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: INFO nova.api.openstack.requestlog [None req-379079e2-cedc-4ec7-8836-32b4bd5376e7 admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.078094 Aug 11 11:01:43.944977 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: [pid: 105897|app: 0|req: 37/72] 10.222.0.48 () {60 vars in 1193 bytes} [Thu Aug 11 11:01:43 2022] GET /compute/v2.1/os-services => generated 794 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 11:01:55.195142 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi [None req-10ba146a-76e0-47d9-88d4-7054604ad28e admin admin] Calling method '>' {{(pid=105896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:01:55.196184 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: INFO nova.api.openstack.requestlog [None req-10ba146a-76e0-47d9-88d4-7054604ad28e admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Aug 11 11:01:55.196586 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: [pid: 105896|app: 0|req: 36/73] 10.222.0.48 () {56 vars in 1074 bytes} [Thu Aug 11 11:01:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:01:55.341921 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG dbcounter [-] [105897] Writing DB stats nova_cell0:SELECT=4 {{(pid=105897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:01:55.342659 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG dbcounter [-] [105897] Writing DB stats nova_cell1:SELECT=4 {{(pid=105897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:01:55.343255 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG dbcounter [-] [105897] Writing DB stats nova_api:SELECT=8 {{(pid=105897) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:01:55.390097 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-6f64e542-e18e-4cc6-b7e1-687cf947a5de admin admin] Calling method '>' {{(pid=105897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:01:55.392478 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 11 11:01:55.392478 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: warnings.warn(msg) Aug 11 11:01:55.393601 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG oslo_concurrency.lockutils [None req-6f64e542-e18e-4cc6-b7e1-687cf947a5de admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:01:55.394076 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG oslo_concurrency.lockutils [None req-6f64e542-e18e-4cc6-b7e1-687cf947a5de admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:01:55.394498 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG oslo_concurrency.lockutils [None req-6f64e542-e18e-4cc6-b7e1-687cf947a5de admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:01:55.395214 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG oslo_concurrency.lockutils [None req-6f64e542-e18e-4cc6-b7e1-687cf947a5de admin admin] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:01:55.395694 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG oslo_concurrency.lockutils [None req-6f64e542-e18e-4cc6-b7e1-687cf947a5de admin admin] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:01:55.396135 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG oslo_concurrency.lockutils [None req-6f64e542-e18e-4cc6-b7e1-687cf947a5de admin admin] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:01:55.421085 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: INFO nova.api.openstack.requestlog [None req-6f64e542-e18e-4cc6-b7e1-687cf947a5de admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.083429 Aug 11 11:01:55.421603 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: [pid: 105897|app: 0|req: 38/74] 10.222.0.48 () {60 vars in 1193 bytes} [Thu Aug 11 11:01:55 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:01:56.245286 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: DEBUG nova.api.openstack.wsgi [None req-10ba146a-76e0-47d9-88d4-7054604ad28e admin admin] Calling method '>' {{(pid=105896) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:01:56.246289 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: INFO nova.api.openstack.requestlog [None req-10ba146a-76e0-47d9-88d4-7054604ad28e admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Aug 11 11:01:56.246680 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: [pid: 105896|app: 0|req: 37/75] 10.222.0.48 () {56 vars in 1074 bytes} [Thu Aug 11 11:01:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:01:56.435678 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG nova.api.openstack.wsgi [None req-efb6302c-6b2a-4e56-885d-00cbdca83e7e admin admin] Calling method '>' {{(pid=105897) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:01:56.438045 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 11 11:01:56.438045 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: warnings.warn(msg) Aug 11 11:01:56.439143 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG oslo_concurrency.lockutils [None req-efb6302c-6b2a-4e56-885d-00cbdca83e7e admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:01:56.440327 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG oslo_concurrency.lockutils [None req-efb6302c-6b2a-4e56-885d-00cbdca83e7e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:01:56.440750 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG oslo_concurrency.lockutils [None req-efb6302c-6b2a-4e56-885d-00cbdca83e7e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:01:56.441709 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG oslo_concurrency.lockutils [None req-efb6302c-6b2a-4e56-885d-00cbdca83e7e admin admin] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:01:56.442148 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG oslo_concurrency.lockutils [None req-efb6302c-6b2a-4e56-885d-00cbdca83e7e admin admin] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:01:56.442556 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: DEBUG oslo_concurrency.lockutils [None req-efb6302c-6b2a-4e56-885d-00cbdca83e7e admin admin] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105897) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:01:56.464208 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: INFO nova.api.openstack.requestlog [None req-efb6302c-6b2a-4e56-885d-00cbdca83e7e admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.079854 Aug 11 11:01:56.464686 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: [pid: 105897|app: 0|req: 39/76] 10.222.0.48 () {60 vars in 1193 bytes} [Thu Aug 11 11:01:56 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:02:53.192778 dv-cinder-820027-17-iscsi devstack@n-api.service[105895]: Thu Aug 11 11:02:53 2022 - graceful shutdown triggered... Aug 11 11:02:53.192902 dv-cinder-820027-17-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 11 11:02:53.193723 dv-cinder-820027-17-iscsi devstack@n-api.service[105897]: Gracefully killing worker 2 (pid: 105897)... Aug 11 11:02:53.194203 dv-cinder-820027-17-iscsi devstack@n-api.service[105896]: Gracefully killing worker 1 (pid: 105896)... Aug 11 11:02:54.193922 dv-cinder-820027-17-iscsi devstack@n-api.service[105895]: worker 1 buried after 1 seconds Aug 11 11:02:54.194450 dv-cinder-820027-17-iscsi devstack@n-api.service[105895]: worker 2 buried after 1 seconds Aug 11 11:02:54.194450 dv-cinder-820027-17-iscsi devstack@n-api.service[105895]: goodbye to uWSGI. Aug 11 11:02:54.195599 dv-cinder-820027-17-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 11 11:02:54.196196 dv-cinder-820027-17-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 11 11:02:54.199006 dv-cinder-820027-17-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 11 11:02:54.210096 dv-cinder-820027-17-iscsi devstack@n-api.service[121214]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 11 11:02:54.212065 dv-cinder-820027-17-iscsi devstack@n-api.service[121214]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 11 11:02:54 2022] *** Aug 11 11:02:54.212065 dv-cinder-820027-17-iscsi devstack@n-api.service[121214]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 11 11:02:54.212065 dv-cinder-820027-17-iscsi devstack@n-api.service[121214]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 11 11:02:54.212065 dv-cinder-820027-17-iscsi devstack@n-api.service[121214]: nodename: dv-cinder-820027-17-iscsi Aug 11 11:02:54.212065 dv-cinder-820027-17-iscsi devstack@n-api.service[121214]: machine: x86_64 Aug 11 11:02:54.212065 dv-cinder-820027-17-iscsi devstack@n-api.service[121214]: clock source: unix Aug 11 11:02:54.212065 dv-cinder-820027-17-iscsi devstack@n-api.service[121214]: pcre jit disabled Aug 11 11:02:54.212065 dv-cinder-820027-17-iscsi devstack@n-api.service[121214]: detected number of CPU cores: 4 Aug 11 11:02:54.212065 dv-cinder-820027-17-iscsi devstack@n-api.service[121214]: current working directory: / Aug 11 11:02:54.212065 dv-cinder-820027-17-iscsi devstack@n-api.service[121214]: detected binary path: /usr/bin/uwsgi-core Aug 11 11:02:54.212870 dv-cinder-820027-17-iscsi devstack@n-api.service[121214]: your processes number limit is 47680 Aug 11 11:02:54.212870 dv-cinder-820027-17-iscsi devstack@n-api.service[121214]: your memory page size is 4096 bytes Aug 11 11:02:54.212870 dv-cinder-820027-17-iscsi devstack@n-api.service[121214]: detected max file descriptor number: 2048 Aug 11 11:02:54.212870 dv-cinder-820027-17-iscsi devstack@n-api.service[121214]: lock engine: pthread robust mutexes Aug 11 11:02:54.212870 dv-cinder-820027-17-iscsi devstack@n-api.service[121214]: thunder lock: enabled Aug 11 11:02:54.212870 dv-cinder-820027-17-iscsi devstack@n-api.service[121214]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 11 11:02:54.212870 dv-cinder-820027-17-iscsi devstack@n-api.service[121214]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 11 11:02:54.252370 dv-cinder-820027-17-iscsi devstack@n-api.service[121214]: Python main interpreter initialized at 0x561579cc49c0 Aug 11 11:02:54.252370 dv-cinder-820027-17-iscsi devstack@n-api.service[121214]: python threads support enabled Aug 11 11:02:54.252370 dv-cinder-820027-17-iscsi devstack@n-api.service[121214]: your server socket listen backlog is limited to 100 connections Aug 11 11:02:54.252370 dv-cinder-820027-17-iscsi devstack@n-api.service[121214]: your mercy for graceful operations on workers is 90 seconds Aug 11 11:02:54.252817 dv-cinder-820027-17-iscsi devstack@n-api.service[121214]: mapped 403077 bytes (393 KB) for 2 cores Aug 11 11:02:54.252817 dv-cinder-820027-17-iscsi devstack@n-api.service[121214]: *** Operational MODE: preforking *** Aug 11 11:02:54.253150 dv-cinder-820027-17-iscsi devstack@n-api.service[121214]: *** uWSGI is running in multiple interpreter mode *** Aug 11 11:02:54.253150 dv-cinder-820027-17-iscsi devstack@n-api.service[121214]: spawned uWSGI master process (pid: 121214) Aug 11 11:02:54.253357 dv-cinder-820027-17-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 11 11:02:54.259820 dv-cinder-820027-17-iscsi devstack@n-api.service[121214]: spawned uWSGI worker 1 (pid: 121231, cores: 1) Aug 11 11:02:54.259820 dv-cinder-820027-17-iscsi devstack@n-api.service[121214]: spawned uWSGI worker 2 (pid: 121232, cores: 1) Aug 11 11:02:54.259820 dv-cinder-820027-17-iscsi devstack@n-api.service[121214]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 11 11:02:54.910926 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 11 11:02:54.918811 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 11 11:02:56.087630 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 11 11:02:56.087630 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: from cryptography.utils import int_from_bytes Aug 11 11:02:56.088285 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 11 11:02:56.088285 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: from cryptography.utils import int_from_bytes Aug 11 11:02:56.094281 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 11 11:02:56.094281 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: from cryptography.utils import int_from_bytes Aug 11 11:02:56.094744 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 11 11:02:56.094744 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: from cryptography.utils import int_from_bytes Aug 11 11:02:58.427959 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 11 11:02:58.428541 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 11 11:02:58.428826 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 11 11:02:58.429092 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 11 11:02:58.429346 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 11 11:02:58.429739 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.430060 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.430378 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.430693 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.431022 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.431331 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.431656 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.432004 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.432328 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.432585 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.432898 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.433219 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-820027-17-iscsi {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.433537 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.433840 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.434149 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.434471 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.434768 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.435082 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.435379 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.435896 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.437280 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.437403 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 11 11:02:58.437778 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.437865 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 11 11:02:58.437953 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.438036 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 11 11:02:58.438114 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.438195 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 11 11:02:58.438550 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.438632 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 11 11:02:58.438714 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.438714 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.438848 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.439141 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.439264 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.439352 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.439441 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.439657 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.439889 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.439995 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.440082 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-820027-17-iscsi {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.440920 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.441150 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.441393 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.441598 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.441844 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.442086 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.442299 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.442505 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.442739 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.442998 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.443320 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.443574 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.443801 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-820027-17-iscsi {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.444012 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.444236 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.444491 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.444762 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.444988 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.445177 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.445433 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.445629 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.445785 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.445975 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.446135 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.446279 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.446428 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.446578 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.446757 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.446757 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.447051 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.447218 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.447375 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.447529 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.447688 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.447890 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.448078 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.448259 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.448412 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.448563 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.448716 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.448866 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.449011 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.449160 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.449311 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.449462 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.449615 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.449767 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.449934 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.450086 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.450086 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.451239 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.451395 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.451541 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-820027-17-iscsi {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.451694 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.451874 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.452302 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.452456 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.452613 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.452768 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.452919 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.453073 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.453228 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.453372 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.453520 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.453670 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.453861 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.454030 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.454175 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.454175 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.454456 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.454605 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.454768 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.454928 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.455082 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.455234 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.455423 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.455574 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.455732 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.455913 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.456061 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.456061 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.456342 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.456342 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.456624 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.456790 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.456942 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.457095 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.457247 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.457396 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.457550 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.457701 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.457852 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.457852 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.458133 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.458283 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.458450 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.458606 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.458749 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.458900 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.459051 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.459200 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.459357 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.459509 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.459660 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.459885 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.460046 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.460205 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.460357 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.461213 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.461372 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.461525 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.461677 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.461836 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.461986 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.462129 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.462278 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.462429 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.462583 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.462737 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.462880 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.463033 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.463187 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.463187 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.463474 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.463625 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.463797 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.463961 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.464105 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.464255 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.464412 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.464562 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.464714 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.464865 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.465019 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.465171 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.465328 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.465517 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.465682 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.465834 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.465987 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.466138 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.466298 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.466441 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.466584 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.466726 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.466878 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.467030 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.467184 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.467326 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.467469 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.467611 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.467777 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.467945 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.468090 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.468242 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.468399 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.468549 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.468700 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.468849 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.469017 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.469160 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.469160 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.469449 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.469598 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.469747 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.469747 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.470032 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.470192 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.470342 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.470492 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.471068 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.471472 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.471637 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.471830 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.471993 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.471993 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.472275 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.472426 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.472570 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.472721 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.472865 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.473008 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.473151 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.473301 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.473524 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.473688 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.473840 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.473984 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.474126 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.474270 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.474423 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.474573 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.474792 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.474979 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.475137 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.475288 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.475441 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.475636 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.475804 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.475955 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.476110 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.476253 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.476419 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.476564 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.476707 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.476895 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.477059 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.477218 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.477370 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.477550 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.477724 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.477877 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.478021 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.478163 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.478306 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.478464 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.478624 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.478768 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.478913 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.479055 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.479197 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.479347 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.479501 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.479664 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.479883 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.480034 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.480185 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.480328 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.480493 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.480644 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.481215 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.481629 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.481787 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.481941 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.482093 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.482255 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.482407 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.482558 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.482714 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.482865 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.483010 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.483191 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.483348 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.483499 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.483644 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.483644 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.483965 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.484109 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.484270 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.484421 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.484563 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.484717 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.484860 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.485022 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.485165 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.485315 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.485471 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.485667 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.485818 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.485970 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.486120 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.486282 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.486438 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.486589 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.486740 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.486892 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 11 11:02:58.487547 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.487711 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.487930 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.488093 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.488263 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.488537 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.488710 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.488858 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.489021 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.489185 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.489331 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.489331 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.489619 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.489772 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.489916 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.490068 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.490213 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.490355 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.490506 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.490649 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.490812 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.491457 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.491846 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.492004 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.492149 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.492304 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.492760 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.492951 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.493102 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.493259 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.493404 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.493556 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.493713 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.493881 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.494033 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.494187 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.494331 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.494474 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.494630 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.494782 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.494932 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.495088 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.495240 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.495392 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.495536 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.495685 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.495911 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.496297 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.496446 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.496602 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.496602 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.496893 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.497044 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.497196 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.497340 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.497492 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.497654 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.497903 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.498079 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.498235 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.498388 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.498541 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.498685 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.498835 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.498978 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.499128 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.499281 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.499427 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.499589 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.499912 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.500064 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.500228 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.500385 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.500538 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.500692 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.500844 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.500989 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.501150 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.501943 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.502108 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.502252 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.502404 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.502548 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.503372 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.503622 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.503798 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.503960 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.504106 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.504247 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.504403 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.504553 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.504698 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.504840 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.504988 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.505142 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.505300 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.505450 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.505606 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.505757 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.505954 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.506099 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.506252 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.506395 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.506538 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.506688 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.506841 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.507021 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.507182 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.507326 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.507490 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.507641 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.507740 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.507853 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.507948 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.508029 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.508124 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.508210 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.508296 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.508396 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.508489 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.508575 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.508575 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.508732 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.508825 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.508963 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.509067 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.509155 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.509241 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.509325 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.509417 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.509512 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.509639 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.509731 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.509818 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.510512 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.510619 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.510723 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.510812 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.510908 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.510995 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.511089 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.511189 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.511294 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.511841 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.511940 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.512054 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.512144 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.512240 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.512340 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.512427 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.512694 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.512788 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.512883 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.512991 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.513080 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.513165 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.513252 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.513339 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.513425 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.513520 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.513616 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.513710 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.513805 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.513892 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.513988 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.514075 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.514075 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.514243 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.514243 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.514243 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.514243 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.514243 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.514243 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.514243 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.514243 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.514872 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.514975 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.514975 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.515149 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.515278 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.515278 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.515278 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.515540 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.515628 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.515713 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.515815 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.515815 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.515815 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.516122 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.516218 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.516218 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.516218 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.516218 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.516218 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.516218 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.516665 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.516759 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.516759 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.516759 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.516759 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.516759 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.517152 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.517238 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.517238 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.517238 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.517238 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.517558 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.517741 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.517888 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.518057 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.518422 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.518523 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.518739 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.519069 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.519162 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.519385 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.519683 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.519804 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.525992 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.526143 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.526259 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.526360 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.526466 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.526562 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.526650 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.526737 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.526838 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.526933 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.527034 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.527133 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.527221 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.527221 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.527221 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.527472 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.527569 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.527664 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.527776 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.527776 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.527959 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.528054 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.528135 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.528221 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.528313 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.528406 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.528501 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.528597 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.528690 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.528785 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.528872 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.531734 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.531868 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.532001 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.532097 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.532203 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.532203 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.532203 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.532504 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.532604 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.532604 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.532604 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.532604 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.532604 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.532604 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.533096 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.533184 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.533184 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.533184 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.533447 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.533621 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.533712 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.533801 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.533917 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.534194 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.534400 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.534521 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.534659 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.534779 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.535037 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.535136 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.535213 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.535213 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.535388 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.535388 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.535388 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.535590 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.535677 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.535677 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.535677 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.535677 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.535677 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.535677 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.535677 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.536358 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.536445 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.536532 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.536532 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.539065 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.539205 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.539313 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.539313 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.539499 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.539589 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.539684 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.539818 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.539909 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.540009 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.540105 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.540204 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.540307 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.540396 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.540489 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.540576 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.540576 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.540576 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.540576 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.540897 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.540991 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.540991 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.541155 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.541660 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.541787 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.541886 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.543831 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.543979 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.544080 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.544170 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.544273 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.544369 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.544465 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.544553 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.544639 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.544733 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.544835 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.544924 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.545018 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.545018 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.545186 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.545286 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.545286 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.545460 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.545679 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.545787 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.546008 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.546271 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.546399 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.546657 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.546888 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.547016 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.547328 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.547473 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.547642 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.548000 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.548124 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.548312 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.551297 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.551428 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.551532 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.551623 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.551623 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.551875 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.551968 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.552062 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.552150 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.552237 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.552349 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.552445 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.552541 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.552629 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.552723 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.552723 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.552723 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.552723 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.553139 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.553231 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.553231 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.553231 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.553478 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.556238 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.556368 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.556465 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.556554 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.556666 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.556666 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.556872 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.556971 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.557060 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.557146 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.557257 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.557257 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.557257 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.557516 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.557604 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.557701 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.557701 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.557701 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.557967 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.558076 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.558076 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.558076 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.558350 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.558490 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.558600 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.559244 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.559342 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.559431 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.559431 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.559857 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.559968 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.560073 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.560374 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.560483 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.561036 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.561189 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.561290 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.561290 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.562032 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.562147 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.562248 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.562248 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.562466 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.562567 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.562777 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.563073 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.563448 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.563655 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.563950 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.564060 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.564298 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.564556 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.564687 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.564916 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.565806 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.565908 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.566325 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.566455 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.566554 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.568132 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.568269 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.568378 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.568478 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.568583 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.568687 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.568784 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.568880 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.568979 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.569068 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.569155 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.569155 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.569383 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.569490 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.569766 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.569985 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.570102 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.570389 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.570550 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.570720 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.571048 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.571155 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.571361 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.571623 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.571742 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.572028 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.572283 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.572401 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.572745 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.572838 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.573091 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.573200 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.573382 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.573486 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.573695 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.574282 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.574425 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.574546 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.574637 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.574637 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.574913 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.575046 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.575384 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.575496 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.575702 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.575840 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.576195 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.576306 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.576510 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.576673 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.576866 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.577122 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.577230 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.577554 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.577657 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.577863 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.578028 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.578193 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.578493 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.578595 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.578811 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.578966 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.579129 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.579424 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.579529 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.579746 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.579957 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.580165 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.580411 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.580510 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.585745 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.585867 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.585961 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.586046 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.586123 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.586197 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.586280 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.586364 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.586577 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.586751 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.586895 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.587027 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.587027 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.587284 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.587415 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.587575 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.587711 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.587943 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.588090 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.588223 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.588353 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.588493 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.588623 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.588795 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.588937 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.589070 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.589208 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.589339 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.589475 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.589615 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.589615 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.589615 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.589615 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.590044 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.590139 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.590255 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.590353 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.590440 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.590548 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.590548 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.590733 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.590851 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.590851 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.591027 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.591121 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.591253 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.591350 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.591350 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.591517 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.591604 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.591727 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.591842 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.591842 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.592019 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.592108 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.592201 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.592288 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.592288 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.592453 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.592548 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.592548 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.592704 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.592797 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.592797 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.592975 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.593064 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.593064 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.593220 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.593313 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.593313 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.593856 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.593954 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.593954 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.594121 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.594207 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.594330 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.594437 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.594641 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.594829 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.595126 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.595291 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.595500 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.595651 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.595866 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.595979 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.596159 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.597004 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.597329 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.597645 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.597748 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.597972 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.598064 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.601613 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.601753 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.601837 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.601920 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.602013 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.602118 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.602213 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.602309 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.602404 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.602489 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.602581 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.602674 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.602759 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.602853 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.602939 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.602939 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.602939 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.602939 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.602939 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.603328 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.603415 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.603506 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.603587 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.603666 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.603752 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.603868 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.603943 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.604016 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.604087 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.604159 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.604239 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.604239 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.604391 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.604673 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.604979 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.605393 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.605779 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.606158 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.606485 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.607221 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.607322 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.607423 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.607509 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.607593 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.607676 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.607794 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.607960 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.608056 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.608314 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.608399 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.608665 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.608748 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.608971 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.609063 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.609279 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.609380 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.609601 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.609769 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.609985 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.610151 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.610308 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.610492 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.610714 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.610887 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.611040 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.611208 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.611361 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.611540 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.611698 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.611911 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.612125 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.612783 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.612935 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.613094 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.613247 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.613408 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.613568 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.613920 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.614336 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.614542 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.614706 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.614706 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.615077 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.615229 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.615387 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.615705 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.616012 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.616176 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.616337 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.616519 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.616687 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.616839 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.617005 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.617206 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.617373 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.617535 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.617686 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.617844 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.618005 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.618162 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.618320 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.618477 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.618628 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.618777 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.618942 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.619107 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.619272 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.619440 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.619611 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.619831 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.620002 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.620168 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.620320 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.620470 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.620634 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.620784 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.620934 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.621092 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.621251 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.621411 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.621586 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.621744 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.621969 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.622140 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.622292 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.622451 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.622604 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.622761 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.622913 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.623072 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.623225 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.623389 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.623540 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.623708 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.624086 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.624436 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.624591 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.624758 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.624918 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.625069 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.625221 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.625371 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.625521 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.625826 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.625995 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.626147 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.626311 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.626463 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.626622 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.626807 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.626971 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.627086 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.627207 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.627367 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.627497 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.627619 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.627780 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.636557 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.636723 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.636826 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.636934 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.637023 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.637110 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.637110 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.637271 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.637366 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.637461 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.637565 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.637660 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.637753 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.637845 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.637935 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.638046 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.638140 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.638232 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.638319 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.638402 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.638502 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.638595 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.638688 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.638780 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.638872 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.638964 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.639063 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.639156 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.639242 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.639326 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.639326 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.639494 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.639586 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.639678 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.639844 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.639965 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.640066 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.640163 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.640249 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.640340 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.640432 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.640517 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.640517 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.640706 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.640795 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.640877 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.640877 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.641040 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.641132 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.641230 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.641316 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.641407 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.641493 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.641586 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.641684 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.641777 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.641869 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.641974 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.642183 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.642274 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.642533 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.642655 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.642750 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.642837 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.642922 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.642922 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.643100 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.643186 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.643299 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.643389 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.643463 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.643546 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.643644 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.643730 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.643835 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.643973 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.644076 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.644182 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.644274 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.644376 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.644465 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.644552 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.644626 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.644718 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.644811 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.644896 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.644990 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.645077 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.645175 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.645261 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.645345 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.645429 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.645537 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.645623 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.645623 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.645800 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.645800 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.646243 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.646334 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.646427 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.646530 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.646613 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.646727 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.646825 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.646901 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.646980 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.647064 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.647139 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.647212 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.647293 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.647368 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.647448 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.647522 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.647602 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.647683 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.647774 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.647854 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.647978 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.648066 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.648139 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.648220 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.648307 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.648916 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.648999 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.649083 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.649165 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.649165 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.649322 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.649408 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.649482 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.649562 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.649636 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.649715 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.649797 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.649878 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.649959 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.650038 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.650120 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.650195 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.650280 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.650353 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.650426 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.650496 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.650576 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.650657 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.650731 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.650802 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.650881 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.650954 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.651034 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.651121 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.651214 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.651289 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.651361 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.651432 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.651513 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.651598 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.651688 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.651789 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.651868 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.651940 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.652013 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.652170 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.652170 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.652333 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.652408 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.652479 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.652565 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.652645 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.652717 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.652789 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.652868 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.652941 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.653115 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.653210 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.654195 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.654315 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.654405 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.654490 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.654588 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.654683 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.654782 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.654891 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.654980 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.655072 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.655072 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.655244 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.655330 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.655420 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.655616 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.655753 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.655979 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.656098 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.656283 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.656381 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.656722 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.656910 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.657002 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.657079 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.657340 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.657435 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.657511 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.657785 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.657878 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.657954 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.658126 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.658266 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.658430 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.658540 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.658748 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.658856 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.659587 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.659685 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.659922 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.660087 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.660259 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.660364 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.666438 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.666582 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.666687 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.666776 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.666870 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.666956 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.667041 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.667127 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.667224 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.667318 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.667404 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.667495 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.667588 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.667696 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.667932 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.668028 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.668114 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.668198 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.668296 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.668398 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.668485 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.668569 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.668569 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.668724 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.668808 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.668973 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.669072 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.669166 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.669282 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.669393 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.669476 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.669562 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.669635 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.669727 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.669898 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.670016 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.670117 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.670215 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.670301 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.670301 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.670456 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.670547 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.670646 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.670731 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.670823 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.670823 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.670980 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.671082 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.671168 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.671261 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.671261 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.671434 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.671520 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.671602 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.671694 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.671802 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.671890 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.671977 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.672051 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.672144 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.672219 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.672290 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.672369 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.672450 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.672523 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.672604 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.672678 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.672756 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.672829 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.672958 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.673069 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.673157 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.673744 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.673850 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.673983 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.674085 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.674184 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.674272 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.674365 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.674460 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.674586 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.675177 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.675272 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.675355 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.675429 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.675500 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.675572 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.675664 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.675741 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.675908 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.675997 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.676095 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.676182 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.676300 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.676401 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.676485 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.676566 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.676639 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.676711 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.676808 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.676894 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.676990 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.677082 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.677241 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.677372 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.677556 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.677671 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.677861 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.677957 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.678165 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.678273 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.678475 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.678672 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.678773 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.678996 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.679089 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.679322 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.679416 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.679651 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.679752 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.679991 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.680082 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.680315 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.680398 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.680620 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.680749 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.680945 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.681053 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.681253 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.681354 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.681557 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.681651 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.681858 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.681965 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.682161 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.682262 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.682461 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.682555 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.682769 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.682874 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.683070 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.683163 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.683378 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.683479 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.683678 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.683806 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.684017 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.684150 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.684318 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.684409 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.684626 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.684728 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.684929 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.685023 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.685249 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.685343 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.685551 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.685644 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.685859 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.685950 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.686168 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.686268 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.686479 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.686592 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.686793 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.686901 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.687097 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.687190 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.687402 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.687508 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.687710 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.687835 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.688043 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.688173 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.688605 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.688850 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.688939 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.689187 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.689282 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.689499 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.689599 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.689807 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.689915 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.690116 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.690236 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.690447 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.690541 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.690756 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.690858 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.691061 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.691165 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.691383 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.691484 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.691694 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.691810 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.692031 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.692161 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.692342 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.692437 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.692651 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.692745 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.692961 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.693074 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.693270 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.693366 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.693580 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.693674 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.693888 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.694115 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.694220 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.694315 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.694491 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.694593 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.694796 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.694891 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.695104 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.695198 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.695412 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.695516 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.695719 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.695874 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.696057 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.696155 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.696371 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.696464 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.696691 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.696858 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.697001 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.697094 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.697317 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.697421 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.697632 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.697728 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.697940 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.698054 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.698247 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.698351 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.698553 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.698648 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.698860 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.698953 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.699171 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.699315 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.699498 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.699621 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.699830 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.699941 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.700141 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.700246 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.700453 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.700554 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.700770 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.700865 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.701085 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.701189 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.701402 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.701496 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.701718 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.701821 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.702032 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.702127 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.702351 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.702455 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.702664 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.702766 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.702983 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.703077 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.703291 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.703391 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.703609 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.703712 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.704011 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.704120 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.704292 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.704393 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.704615 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.704761 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.704917 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.705019 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.705221 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.705322 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.705522 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.705627 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.705883 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.705988 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.706208 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.706304 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.706517 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.706613 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.706763 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121232) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 11 11:02:58.706853 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.707110 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.707414 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.707716 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.708043 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.708344 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.708645 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.708954 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.709253 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.709554 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.709854 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.710159 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.710460 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.710761 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.711068 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.711369 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.711671 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.711995 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.712301 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.712599 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.712938 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.713271 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.713584 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.713905 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.714214 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.714532 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.715419 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.715419 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.715623 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.715799 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.716092 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.716425 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.716735 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.717161 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.717355 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.717664 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.717972 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.718281 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.718614 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.718938 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.719242 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.719565 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.719908 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.720239 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.720554 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.720864 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.721191 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.722066 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.722403 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.722674 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.722984 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.723292 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.723605 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.723938 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.724251 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.724567 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.724881 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.725213 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.725537 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.725845 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.726168 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.726494 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.726847 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.727159 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.727507 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.727859 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.728175 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.728486 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.728791 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 11 11:02:58.729034 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 11 11:02:58.858776 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO dbcounter [None req-0fda3102-390f-4127-905e-7208f5b8b000 None None] Registered counter for database nova_api Aug 11 11:02:58.879379 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_db.sqlalchemy.engines [None req-0fda3102-390f-4127-905e-7208f5b8b000 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121232) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 11 11:02:58.881389 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO dbcounter [None req-b0181179-553b-406b-b5e8-c32e48999133 None None] Registered counter for database nova_api Aug 11 11:02:58.886187 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writer thread running {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 11 11:02:58.900967 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_db.sqlalchemy.engines [None req-b0181179-553b-406b-b5e8-c32e48999133 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121231) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 11 11:02:58.907475 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writer thread running {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 11 11:02:58.946545 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.context [None req-0fda3102-390f-4127-905e-7208f5b8b000 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0(cell1) {{(pid=121232) load_cells /opt/stack/nova/nova/context.py:464}} Aug 11 11:02:58.950675 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0fda3102-390f-4127-905e-7208f5b8b000 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:02:58.951162 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0fda3102-390f-4127-905e-7208f5b8b000 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:02:58.952806 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0fda3102-390f-4127-905e-7208f5b8b000 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:02:58.953595 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0fda3102-390f-4127-905e-7208f5b8b000 None None] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:02:58.954102 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0fda3102-390f-4127-905e-7208f5b8b000 None None] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:02:58.956606 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0fda3102-390f-4127-905e-7208f5b8b000 None None] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:02:58.958592 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO dbcounter [None req-0fda3102-390f-4127-905e-7208f5b8b000 None None] Registered counter for database nova_cell0 Aug 11 11:02:58.962728 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO dbcounter [None req-0fda3102-390f-4127-905e-7208f5b8b000 None None] Registered counter for database nova_cell1 Aug 11 11:02:58.970038 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_db.sqlalchemy.engines [None req-0fda3102-390f-4127-905e-7208f5b8b000 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121232) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 11 11:02:58.971223 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.context [None req-b0181179-553b-406b-b5e8-c32e48999133 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0(cell1) {{(pid=121231) load_cells /opt/stack/nova/nova/context.py:464}} Aug 11 11:02:58.973192 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_db.sqlalchemy.engines [None req-0fda3102-390f-4127-905e-7208f5b8b000 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121232) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 11 11:02:58.975887 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b0181179-553b-406b-b5e8-c32e48999133 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:02:58.977295 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b0181179-553b-406b-b5e8-c32e48999133 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:02:58.977960 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b0181179-553b-406b-b5e8-c32e48999133 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:02:58.978736 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b0181179-553b-406b-b5e8-c32e48999133 None None] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:02:58.979187 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b0181179-553b-406b-b5e8-c32e48999133 None None] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:02:58.980748 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writer thread running {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 11 11:02:58.981093 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writer thread running {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 11 11:02:58.981206 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b0181179-553b-406b-b5e8-c32e48999133 None None] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:02:58.983201 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO dbcounter [None req-b0181179-553b-406b-b5e8-c32e48999133 None None] Registered counter for database nova_cell0 Aug 11 11:02:58.987298 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO dbcounter [None req-b0181179-553b-406b-b5e8-c32e48999133 None None] Registered counter for database nova_cell1 Aug 11 11:02:58.994747 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_db.sqlalchemy.engines [None req-b0181179-553b-406b-b5e8-c32e48999133 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121231) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 11 11:02:58.996411 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_db.sqlalchemy.engines [None req-b0181179-553b-406b-b5e8-c32e48999133 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121231) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 11 11:02:59.003144 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writer thread running {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 11 11:02:59.004470 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writer thread running {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 11 11:02:59.127547 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO dbcounter [None req-0fda3102-390f-4127-905e-7208f5b8b000 None None] Registered counter for database nova_cell0 Aug 11 11:02:59.134417 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_db.sqlalchemy.engines [None req-0fda3102-390f-4127-905e-7208f5b8b000 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121232) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 11 11:02:59.138816 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writer thread running {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 11 11:02:59.150161 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO dbcounter [None req-b0181179-553b-406b-b5e8-c32e48999133 None None] Registered counter for database nova_cell0 Aug 11 11:02:59.157131 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_db.sqlalchemy.engines [None req-b0181179-553b-406b-b5e8-c32e48999133 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121231) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 11 11:02:59.162074 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writer thread running {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 11 11:02:59.461107 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: WARNING keystonemiddleware.auth_token [None req-0fda3102-390f-4127-905e-7208f5b8b000 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 11 11:02:59.468598 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: WARNING keystonemiddleware.auth_token [None req-0fda3102-390f-4127-905e-7208f5b8b000 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 11 11:02:59.482269 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: WARNING keystonemiddleware.auth_token [None req-b0181179-553b-406b-b5e8-c32e48999133 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 11 11:02:59.490064 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: WARNING keystonemiddleware.auth_token [None req-b0181179-553b-406b-b5e8-c32e48999133 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 11 11:02:59.818723 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: WARNING keystonemiddleware.auth_token [None req-0fda3102-390f-4127-905e-7208f5b8b000 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 11 11:02:59.824833 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: WARNING keystonemiddleware.auth_token [None req-0fda3102-390f-4127-905e-7208f5b8b000 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 11 11:02:59.831812 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x561579cc49c0 pid: 121232 (default app) Aug 11 11:02:59.842610 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: WARNING keystonemiddleware.auth_token [None req-b0181179-553b-406b-b5e8-c32e48999133 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 11 11:02:59.849268 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: WARNING keystonemiddleware.auth_token [None req-b0181179-553b-406b-b5e8-c32e48999133 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 11 11:02:59.855483 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x561579cc49c0 pid: 121231 (default app) Aug 11 11:03:35.481604 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_api:SELECT=3 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:03:35.482505 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell0:SELECT=3 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:03:35.483341 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=3 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:03:35.484507 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell0:SELECT=3 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:03:36.676034 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_api:SELECT=3 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:03:36.679907 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell1:SELECT=3 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:03:36.680696 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell0:SELECT=3 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:03:36.681464 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell0:SELECT=3 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:03:37.085936 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-2399bcad-5fb0-4149-9026-793529172ad5 tempest-VolumesNegativeTest-1086445182 tempest-VolumesNegativeTest-1086445182-project] Action: 'create', calling method: .version_select at 0x7faab2bfadc0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1893502229", "metadata": {"Type": "work"}}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:03:37.093917 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-2399bcad-5fb0-4149-9026-793529172ad5 tempest-VolumesNegativeTest-1086445182 tempest-VolumesNegativeTest-1086445182-project] Request method failure captured: Aug 11 11:03:37.093917 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 11 11:03:37.093917 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Accept: application/json Aug 11 11:03:37.093917 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Accept-Encoding: identity Aug 11 11:03:37.093917 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Connection: close Aug 11 11:03:37.093917 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Content-Length: 122 Aug 11 11:03:37.093917 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Content-Type: application/json Aug 11 11:03:37.093917 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Host: 10.222.0.48 Aug 11 11:03:37.093917 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Openstack-System-Scope: None Aug 11 11:03:37.093917 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: User-Agent: python-urllib3/1.26.11 Aug 11 11:03:37.093917 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Auth-Token: gAAAAABi9OIHk7HlMkM3lKXGfrRSiCNpzjT7Ucm3jN1KbzP2kWoQF07zt9pS7_ALTEzGfM7Te30JWGzgjx_-G1F_Z6TX03djJIMKuw4UfjwDBuaT0UGfKtn71IcowIX7a8MDZ1mwNLcLnePHxTAUOH9q73JvpQMINxN9B78SrWWqZfadzdaLyfw Aug 11 11:03:37.093917 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Domain-Id: None Aug 11 11:03:37.093917 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Domain-Name: None Aug 11 11:03:37.093917 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Identity-Status: Confirmed Aug 11 11:03:37.093917 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Is-Admin-Project: True Aug 11 11:03:37.093917 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Domain-Id: default Aug 11 11:03:37.093917 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Domain-Name: Default Aug 11 11:03:37.093917 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Id: 8b25b6f3331a4ad49c7312a3a4bc3154 Aug 11 11:03:37.093917 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Name: tempest-VolumesNegativeTest-1086445182 Aug 11 11:03:37.093917 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Role: reader,member Aug 11 11:03:37.093917 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Roles: reader,member Aug 11 11:03:37.095686 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b25b6f3331a4ad49c7312a3a4bc3154"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b25b6f3331a4ad49c7312a3a4bc3154"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8b25b6f3331a4ad49c7312a3a4bc3154"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8b25b6f3331a4ad49c7312a3a4bc3154", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] Aug 11 11:03:37.095686 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Tenant: tempest-VolumesNegativeTest-1086445182 Aug 11 11:03:37.095686 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Tenant-Id: 8b25b6f3331a4ad49c7312a3a4bc3154 Aug 11 11:03:37.095686 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Tenant-Name: tempest-VolumesNegativeTest-1086445182 Aug 11 11:03:37.095686 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User: tempest-VolumesNegativeTest-1086445182-project Aug 11 11:03:37.095686 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Domain-Id: default Aug 11 11:03:37.095686 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Domain-Name: Default Aug 11 11:03:37.095686 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Id: 7571d52d0a1f4aa4a9d0dd6dfe2c7a76 Aug 11 11:03:37.095686 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Name: tempest-VolumesNegativeTest-1086445182-project Aug 11 11:03:37.095686 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Aug 11 11:03:37.095686 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1893502229", "metadata": {"Type": "work"}}} Aug 11 11:03:37.095686 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: method: Aug 11 11:03:37.095686 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 11 11:03:37.096560 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1893502229', 'metadata': {'Type': 'work'}}}} Aug 11 11:03:37.096560 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 11:03:37.096560 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:03:37.096560 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 11 11:03:37.096560 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 11 11:03:37.096560 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 11 11:03:37.096560 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise error Aug 11 11:03:37.096560 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 11 11:03:37.096560 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:03:37.096560 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 11 11:03:37.096560 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 11 11:03:37.096560 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:03:37.096560 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 11 11:03:37.096560 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi '#$%' Aug 11 11:03:37.096560 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:03:37.096560 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:03:37.096560 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:03:37.096560 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:03:37.096560 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:03:37.096560 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:03:37.096560 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 11:03:37.096560 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 11:03:37.098306 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 11 11:03:37.098306 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 11 11:03:37.098306 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 11:03:37.098306 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 11:03:37.098306 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 11 11:03:37.098306 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 11 11:03:37.098306 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 11 11:03:37.098306 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 11 11:03:37.098306 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 11 11:03:37.098306 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 11 11:03:37.098306 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 11 11:03:37.098306 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:03:37.098306 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:03:37.098306 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:03:37.098306 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:03:37.098306 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:03:37.098306 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:03:37.098306 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 11 11:03:37.098306 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 11 11:03:37.099464 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 11 11:03:37.099464 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:03:37.100917 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-2399bcad-5fb0-4149-9026-793529172ad5 tempest-VolumesNegativeTest-1086445182 tempest-VolumesNegativeTest-1086445182-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=121232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 11:03:37.102275 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-2399bcad-5fb0-4149-9026-793529172ad5 tempest-VolumesNegativeTest-1086445182 tempest-VolumesNegativeTest-1086445182-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.629793 Aug 11 11:03:37.103410 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 1/1] 10.222.0.48 () {60 vars in 1156 bytes} [Thu Aug 11 11:03:35 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1632 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 11 11:03:37.114002 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-772f1307-aea2-49dd-9617-53029771a5bc tempest-VolumesNegativeTest-1086445182 tempest-VolumesNegativeTest-1086445182-project] Action: 'create', calling method: .version_select at 0x7faab2b0f8b0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1566271472", "metadata": {"Type": "work"}}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:03:37.118894 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-772f1307-aea2-49dd-9617-53029771a5bc tempest-VolumesNegativeTest-1086445182 tempest-VolumesNegativeTest-1086445182-project] Request method failure captured: Aug 11 11:03:37.118894 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 11 11:03:37.118894 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Accept: application/json Aug 11 11:03:37.118894 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Accept-Encoding: identity Aug 11 11:03:37.118894 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Connection: close Aug 11 11:03:37.118894 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Content-Length: 120 Aug 11 11:03:37.118894 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Content-Type: application/json Aug 11 11:03:37.118894 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Host: 10.222.0.48 Aug 11 11:03:37.118894 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Openstack-System-Scope: None Aug 11 11:03:37.118894 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: User-Agent: python-urllib3/1.26.11 Aug 11 11:03:37.118894 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Auth-Token: gAAAAABi9OIHk7HlMkM3lKXGfrRSiCNpzjT7Ucm3jN1KbzP2kWoQF07zt9pS7_ALTEzGfM7Te30JWGzgjx_-G1F_Z6TX03djJIMKuw4UfjwDBuaT0UGfKtn71IcowIX7a8MDZ1mwNLcLnePHxTAUOH9q73JvpQMINxN9B78SrWWqZfadzdaLyfw Aug 11 11:03:37.118894 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Domain-Id: None Aug 11 11:03:37.118894 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Domain-Name: None Aug 11 11:03:37.118894 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Identity-Status: Confirmed Aug 11 11:03:37.118894 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Is-Admin-Project: True Aug 11 11:03:37.118894 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Domain-Id: default Aug 11 11:03:37.118894 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Domain-Name: Default Aug 11 11:03:37.118894 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Id: 8b25b6f3331a4ad49c7312a3a4bc3154 Aug 11 11:03:37.118894 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Name: tempest-VolumesNegativeTest-1086445182 Aug 11 11:03:37.118894 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Role: reader,member Aug 11 11:03:37.118894 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Roles: reader,member Aug 11 11:03:37.120272 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b25b6f3331a4ad49c7312a3a4bc3154"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b25b6f3331a4ad49c7312a3a4bc3154"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8b25b6f3331a4ad49c7312a3a4bc3154"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8b25b6f3331a4ad49c7312a3a4bc3154", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] Aug 11 11:03:37.120272 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Tenant: tempest-VolumesNegativeTest-1086445182 Aug 11 11:03:37.120272 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Tenant-Id: 8b25b6f3331a4ad49c7312a3a4bc3154 Aug 11 11:03:37.120272 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Tenant-Name: tempest-VolumesNegativeTest-1086445182 Aug 11 11:03:37.120272 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User: tempest-VolumesNegativeTest-1086445182-project Aug 11 11:03:37.120272 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Domain-Id: default Aug 11 11:03:37.120272 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Domain-Name: Default Aug 11 11:03:37.120272 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Id: 7571d52d0a1f4aa4a9d0dd6dfe2c7a76 Aug 11 11:03:37.120272 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Name: tempest-VolumesNegativeTest-1086445182-project Aug 11 11:03:37.120272 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Aug 11 11:03:37.120272 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1566271472", "metadata": {"Type": "work"}}} Aug 11 11:03:37.120272 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: method: Aug 11 11:03:37.120272 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 11 11:03:37.121091 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1566271472', 'metadata': {'Type': 'work'}}}} Aug 11 11:03:37.121091 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 11:03:37.121091 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:03:37.121091 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 11 11:03:37.121091 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 11 11:03:37.121091 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 11 11:03:37.121091 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise error Aug 11 11:03:37.121091 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 11 11:03:37.121091 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:03:37.121091 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 11 11:03:37.121091 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 11 11:03:37.121091 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:03:37.121091 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 11 11:03:37.121091 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi '0' Aug 11 11:03:37.121091 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:03:37.121091 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:03:37.121091 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:03:37.121091 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:03:37.121091 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:03:37.121091 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:03:37.121091 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 11:03:37.121091 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 11:03:37.122433 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 11 11:03:37.122433 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 11 11:03:37.122433 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 11:03:37.122433 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 11:03:37.122433 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 11 11:03:37.122433 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 11 11:03:37.122433 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 11 11:03:37.122433 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 11 11:03:37.122433 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 11 11:03:37.122433 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 11 11:03:37.122433 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 11 11:03:37.122433 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:03:37.122433 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:03:37.122433 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:03:37.122433 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:03:37.122433 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:03:37.122433 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:03:37.122433 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 11 11:03:37.122433 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 11 11:03:37.123567 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 11 11:03:37.123567 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:03:37.127147 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-772f1307-aea2-49dd-9617-53029771a5bc tempest-VolumesNegativeTest-1086445182 tempest-VolumesNegativeTest-1086445182-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=121232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 11:03:37.135343 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-772f1307-aea2-49dd-9617-53029771a5bc tempest-VolumesNegativeTest-1086445182 tempest-VolumesNegativeTest-1086445182-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.018708 Aug 11 11:03:37.135343 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 2/2] 10.222.0.48 () {60 vars in 1156 bytes} [Thu Aug 11 11:03:37 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 11 11:03:37.163046 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-ab4d8fda-5e84-4628-a732-4ee95ca86121 tempest-VolumesNegativeTest-1086445182 tempest-VolumesNegativeTest-1086445182-project] Action: 'create', calling method: .version_select at 0x7faab2ab7940>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-339204018", "metadata": {"Type": "work"}}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:03:37.169716 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-ab4d8fda-5e84-4628-a732-4ee95ca86121 tempest-VolumesNegativeTest-1086445182 tempest-VolumesNegativeTest-1086445182-project] Request method failure captured: Aug 11 11:03:37.169716 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 11 11:03:37.169716 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Accept: application/json Aug 11 11:03:37.169716 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Accept-Encoding: identity Aug 11 11:03:37.169716 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Connection: close Aug 11 11:03:37.169716 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Content-Length: 118 Aug 11 11:03:37.169716 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Content-Type: application/json Aug 11 11:03:37.169716 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Host: 10.222.0.48 Aug 11 11:03:37.169716 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Openstack-System-Scope: None Aug 11 11:03:37.169716 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: User-Agent: python-urllib3/1.26.11 Aug 11 11:03:37.169716 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Auth-Token: gAAAAABi9OIHk7HlMkM3lKXGfrRSiCNpzjT7Ucm3jN1KbzP2kWoQF07zt9pS7_ALTEzGfM7Te30JWGzgjx_-G1F_Z6TX03djJIMKuw4UfjwDBuaT0UGfKtn71IcowIX7a8MDZ1mwNLcLnePHxTAUOH9q73JvpQMINxN9B78SrWWqZfadzdaLyfw Aug 11 11:03:37.169716 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Domain-Id: None Aug 11 11:03:37.169716 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Domain-Name: None Aug 11 11:03:37.169716 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Identity-Status: Confirmed Aug 11 11:03:37.169716 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Is-Admin-Project: True Aug 11 11:03:37.169716 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Domain-Id: default Aug 11 11:03:37.169716 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Domain-Name: Default Aug 11 11:03:37.169716 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Id: 8b25b6f3331a4ad49c7312a3a4bc3154 Aug 11 11:03:37.169716 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Name: tempest-VolumesNegativeTest-1086445182 Aug 11 11:03:37.169716 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Role: reader,member Aug 11 11:03:37.169716 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Roles: reader,member Aug 11 11:03:37.171857 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b25b6f3331a4ad49c7312a3a4bc3154"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b25b6f3331a4ad49c7312a3a4bc3154"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8b25b6f3331a4ad49c7312a3a4bc3154"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8b25b6f3331a4ad49c7312a3a4bc3154", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] Aug 11 11:03:37.171857 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Tenant: tempest-VolumesNegativeTest-1086445182 Aug 11 11:03:37.171857 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Tenant-Id: 8b25b6f3331a4ad49c7312a3a4bc3154 Aug 11 11:03:37.171857 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Tenant-Name: tempest-VolumesNegativeTest-1086445182 Aug 11 11:03:37.171857 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User: tempest-VolumesNegativeTest-1086445182-project Aug 11 11:03:37.171857 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Domain-Id: default Aug 11 11:03:37.171857 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Domain-Name: Default Aug 11 11:03:37.171857 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Id: 7571d52d0a1f4aa4a9d0dd6dfe2c7a76 Aug 11 11:03:37.171857 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Name: tempest-VolumesNegativeTest-1086445182-project Aug 11 11:03:37.171857 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Aug 11 11:03:37.171857 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-339204018", "metadata": {"Type": "work"}}} Aug 11 11:03:37.171857 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: method: Aug 11 11:03:37.171857 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 11 11:03:37.172894 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-339204018', 'metadata': {'Type': 'work'}}}} Aug 11 11:03:37.172894 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 11:03:37.172894 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:03:37.172894 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 11 11:03:37.172894 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 11 11:03:37.172894 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 11 11:03:37.172894 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise error Aug 11 11:03:37.172894 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 11 11:03:37.172894 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:03:37.172894 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 11 11:03:37.172894 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 11 11:03:37.172894 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:03:37.172894 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 11 11:03:37.172894 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi '' Aug 11 11:03:37.172894 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:03:37.172894 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:03:37.172894 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:03:37.172894 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:03:37.172894 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:03:37.172894 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:03:37.172894 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 11:03:37.172894 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 11:03:37.174303 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 11 11:03:37.174303 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 11 11:03:37.174303 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 11:03:37.174303 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 11:03:37.174303 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 11 11:03:37.174303 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 11 11:03:37.174303 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 11 11:03:37.174303 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 11 11:03:37.174303 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 11 11:03:37.174303 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 11 11:03:37.174303 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 11 11:03:37.174303 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:03:37.174303 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:03:37.174303 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:03:37.174303 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:03:37.174303 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:03:37.174303 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:03:37.174303 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 11 11:03:37.174303 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 11 11:03:37.175511 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 11 11:03:37.175511 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:03:37.176856 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-ab4d8fda-5e84-4628-a732-4ee95ca86121 tempest-VolumesNegativeTest-1086445182 tempest-VolumesNegativeTest-1086445182-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=121232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 11:03:37.177840 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-ab4d8fda-5e84-4628-a732-4ee95ca86121 tempest-VolumesNegativeTest-1086445182 tempest-VolumesNegativeTest-1086445182-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.018637 Aug 11 11:03:37.192485 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 3/3] 10.222.0.48 () {60 vars in 1156 bytes} [Thu Aug 11 11:03:37 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 11 11:03:37.205359 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-30c2e383-6732-4dc4-a3fd-17b836052afd tempest-VolumesNegativeTest-1086445182 tempest-VolumesNegativeTest-1086445182-project] Calling method '.version_select at 0x7faab2ab7670>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:03:37.612741 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.wsgi [None req-30c2e383-6732-4dc4-a3fd-17b836052afd tempest-VolumesNegativeTest-1086445182 tempest-VolumesNegativeTest-1086445182-project] HTTP exception thrown: Volume tempest-invalid-680177864 could not be found. Aug 11 11:03:37.617732 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-30c2e383-6732-4dc4-a3fd-17b836052afd tempest-VolumesNegativeTest-1086445182 tempest-VolumesNegativeTest-1086445182-project] Request method failure captured: Aug 11 11:03:37.617732 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-680177864 HTTP/1.1 Aug 11 11:03:37.617732 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Accept: application/json Aug 11 11:03:37.617732 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Accept-Encoding: identity Aug 11 11:03:37.617732 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Connection: close Aug 11 11:03:37.617732 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Content-Length: 0 Aug 11 11:03:37.617732 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Content-Type: application/json Aug 11 11:03:37.617732 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Host: 10.222.0.48 Aug 11 11:03:37.617732 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Openstack-System-Scope: None Aug 11 11:03:37.617732 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: User-Agent: python-urllib3/1.26.11 Aug 11 11:03:37.617732 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Auth-Token: gAAAAABi9OIHk7HlMkM3lKXGfrRSiCNpzjT7Ucm3jN1KbzP2kWoQF07zt9pS7_ALTEzGfM7Te30JWGzgjx_-G1F_Z6TX03djJIMKuw4UfjwDBuaT0UGfKtn71IcowIX7a8MDZ1mwNLcLnePHxTAUOH9q73JvpQMINxN9B78SrWWqZfadzdaLyfw Aug 11 11:03:37.617732 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Domain-Id: None Aug 11 11:03:37.617732 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Domain-Name: None Aug 11 11:03:37.617732 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Identity-Status: Confirmed Aug 11 11:03:37.617732 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Is-Admin-Project: True Aug 11 11:03:37.617732 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Domain-Id: default Aug 11 11:03:37.617732 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Domain-Name: Default Aug 11 11:03:37.617732 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Id: 8b25b6f3331a4ad49c7312a3a4bc3154 Aug 11 11:03:37.617732 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Name: tempest-VolumesNegativeTest-1086445182 Aug 11 11:03:37.617732 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Role: reader,member Aug 11 11:03:37.617732 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Roles: reader,member Aug 11 11:03:37.619241 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b25b6f3331a4ad49c7312a3a4bc3154"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b25b6f3331a4ad49c7312a3a4bc3154"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8b25b6f3331a4ad49c7312a3a4bc3154"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8b25b6f3331a4ad49c7312a3a4bc3154", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] Aug 11 11:03:37.619241 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Tenant: tempest-VolumesNegativeTest-1086445182 Aug 11 11:03:37.619241 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Tenant-Id: 8b25b6f3331a4ad49c7312a3a4bc3154 Aug 11 11:03:37.619241 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Tenant-Name: tempest-VolumesNegativeTest-1086445182 Aug 11 11:03:37.619241 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User: tempest-VolumesNegativeTest-1086445182-project Aug 11 11:03:37.619241 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Domain-Id: default Aug 11 11:03:37.619241 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Domain-Name: Default Aug 11 11:03:37.619241 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Id: 7571d52d0a1f4aa4a9d0dd6dfe2c7a76 Aug 11 11:03:37.619241 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Name: tempest-VolumesNegativeTest-1086445182-project Aug 11 11:03:37.619241 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: method: Aug 11 11:03:37.619241 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: exception: Volume tempest-invalid-680177864 could not be found. Aug 11 11:03:37.619241 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: action_args: {'id': 'tempest-invalid-680177864'} Aug 11 11:03:37.619241 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 11:03:37.620326 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:03:37.620326 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 11 11:03:37.620326 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 11 11:03:37.620326 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 11 11:03:37.620326 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 11 11:03:37.620326 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 11 11:03:37.620326 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 11 11:03:37.620326 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 11 11:03:37.620326 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 11 11:03:37.620326 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 11 11:03:37.620326 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 11 11:03:37.620326 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 11 11:03:37.620326 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 11 11:03:37.620326 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 11 11:03:37.620326 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 11 11:03:37.620326 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-680177864 could not be found. (HTTP 404) (Request-ID: req-dfa4bbc8-5ff1-410a-90d0-56fe80e0eade) Aug 11 11:03:37.620326 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:03:37.620326 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:03:37.620326 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:03:37.621744 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:03:37.621744 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 11 11:03:37.621744 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 11 11:03:37.621744 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 11 11:03:37.621744 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 11 11:03:37.621744 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 11 11:03:37.621744 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 11 11:03:37.621744 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 11 11:03:37.621744 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 11 11:03:37.621744 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 11 11:03:37.621744 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 11 11:03:37.621744 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 11 11:03:37.621744 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 11 11:03:37.621744 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 11 11:03:37.621744 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 11 11:03:37.621744 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 11 11:03:37.621744 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 11 11:03:37.621744 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 11 11:03:37.621744 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 11 11:03:37.623141 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 11 11:03:37.623141 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 11 11:03:37.623141 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 11 11:03:37.623141 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 11 11:03:37.623141 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-680177864 could not be found. Aug 11 11:03:37.623141 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:03:37.623141 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:03:37.623141 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:03:37.623141 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:03:37.623141 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:03:37.623141 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:03:37.623141 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 11:03:37.623141 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 11:03:37.623141 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 11 11:03:37.623141 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 11 11:03:37.623141 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 11:03:37.623141 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 11:03:37.623141 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 11 11:03:37.623141 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 11:03:37.623141 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-680177864 could not be found. Aug 11 11:03:37.629621 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:03:37.629621 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:03:37.629621 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:03:37.629621 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:03:37.629621 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:03:37.629621 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:03:37.629621 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 11:03:37.629621 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 11:03:37.629621 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-680177864 could not be found. Aug 11 11:03:37.629621 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:03:37.629621 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-30c2e383-6732-4dc4-a3fd-17b836052afd tempest-VolumesNegativeTest-1086445182 tempest-VolumesNegativeTest-1086445182-project] Returning 404 to user: Volume tempest-invalid-680177864 could not be found. {{(pid=121232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 11:03:37.629621 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-30c2e383-6732-4dc4-a3fd-17b836052afd tempest-VolumesNegativeTest-1086445182 tempest-VolumesNegativeTest-1086445182-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/tempest-invalid-680177864" status: 404 len: 98 microversion: 2.1 time: 0.426321 Aug 11 11:03:37.629621 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 4/4] 10.222.0.48 () {58 vars in 1215 bytes} [Thu Aug 11 11:03:37 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-680177864 => generated 98 bytes in 427 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 11 11:03:37.640342 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-b9349049-2a33-46c0-a345-0bedb9e26240 tempest-VolumesNegativeTest-1086445182 tempest-VolumesNegativeTest-1086445182-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006642 Aug 11 11:03:37.646829 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 5/5] 10.222.0.48 () {58 vars in 1140 bytes} [Thu Aug 11 11:03:37 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 14 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 11 11:03:37.651925 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-12f2a01a-a315-49f2-891e-77b4aeb12118 tempest-VolumesNegativeTest-1086445182 tempest-VolumesNegativeTest-1086445182-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004050 Aug 11 11:03:37.652488 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 6/6] 10.222.0.48 () {58 vars in 1137 bytes} [Thu Aug 11 11:03:37 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 11 11:03:37.667480 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-92a0ee69-db5f-4483-857b-cd9a14f7964d tempest-VolumesNegativeTest-1086445182 tempest-VolumesNegativeTest-1086445182-project] Calling method '.version_select at 0x7faab2a02ca0>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:03:37.692789 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-c2a204a2-097d-41c8-8073-d8745e0e1ceb tempest-VolumesSnapshotsTestJSON-1424857693 tempest-VolumesSnapshotsTestJSON-1424857693-project] Action: 'create', calling method: .version_select at 0x7faab2bf3e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-162276551"}} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:03:37.706200 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.wsgi [None req-92a0ee69-db5f-4483-857b-cd9a14f7964d tempest-VolumesNegativeTest-1086445182 tempest-VolumesNegativeTest-1086445182-project] HTTP exception thrown: Volume f1b06c74-0f59-489e-aa2b-5636bd1e2fdd could not be found. Aug 11 11:03:37.708377 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-92a0ee69-db5f-4483-857b-cd9a14f7964d tempest-VolumesNegativeTest-1086445182 tempest-VolumesNegativeTest-1086445182-project] Request method failure captured: Aug 11 11:03:37.708377 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: request: DELETE /compute/v2.1/os-volumes/f1b06c74-0f59-489e-aa2b-5636bd1e2fdd HTTP/1.1 Aug 11 11:03:37.708377 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Accept: application/json Aug 11 11:03:37.708377 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Accept-Encoding: identity Aug 11 11:03:37.708377 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Connection: close Aug 11 11:03:37.708377 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Content-Length: 0 Aug 11 11:03:37.708377 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Content-Type: application/json Aug 11 11:03:37.708377 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Host: 10.222.0.48 Aug 11 11:03:37.708377 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Openstack-System-Scope: None Aug 11 11:03:37.708377 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: User-Agent: python-urllib3/1.26.11 Aug 11 11:03:37.708377 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Auth-Token: gAAAAABi9OIHk7HlMkM3lKXGfrRSiCNpzjT7Ucm3jN1KbzP2kWoQF07zt9pS7_ALTEzGfM7Te30JWGzgjx_-G1F_Z6TX03djJIMKuw4UfjwDBuaT0UGfKtn71IcowIX7a8MDZ1mwNLcLnePHxTAUOH9q73JvpQMINxN9B78SrWWqZfadzdaLyfw Aug 11 11:03:37.708377 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Domain-Id: None Aug 11 11:03:37.708377 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Domain-Name: None Aug 11 11:03:37.708377 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Identity-Status: Confirmed Aug 11 11:03:37.708377 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Is-Admin-Project: True Aug 11 11:03:37.708377 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Domain-Id: default Aug 11 11:03:37.708377 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Domain-Name: Default Aug 11 11:03:37.708377 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Id: 8b25b6f3331a4ad49c7312a3a4bc3154 Aug 11 11:03:37.708377 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Name: tempest-VolumesNegativeTest-1086445182 Aug 11 11:03:37.708377 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Role: reader,member Aug 11 11:03:37.708377 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Roles: reader,member Aug 11 11:03:37.709698 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b25b6f3331a4ad49c7312a3a4bc3154"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b25b6f3331a4ad49c7312a3a4bc3154"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8b25b6f3331a4ad49c7312a3a4bc3154"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8b25b6f3331a4ad49c7312a3a4bc3154", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] Aug 11 11:03:37.709698 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Tenant: tempest-VolumesNegativeTest-1086445182 Aug 11 11:03:37.709698 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Tenant-Id: 8b25b6f3331a4ad49c7312a3a4bc3154 Aug 11 11:03:37.709698 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Tenant-Name: tempest-VolumesNegativeTest-1086445182 Aug 11 11:03:37.709698 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User: tempest-VolumesNegativeTest-1086445182-project Aug 11 11:03:37.709698 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Domain-Id: default Aug 11 11:03:37.709698 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Domain-Name: Default Aug 11 11:03:37.709698 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Id: 7571d52d0a1f4aa4a9d0dd6dfe2c7a76 Aug 11 11:03:37.709698 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Name: tempest-VolumesNegativeTest-1086445182-project Aug 11 11:03:37.709698 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: method: Aug 11 11:03:37.709698 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: exception: Volume f1b06c74-0f59-489e-aa2b-5636bd1e2fdd could not be found. Aug 11 11:03:37.709698 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: action_args: {'id': 'f1b06c74-0f59-489e-aa2b-5636bd1e2fdd'} Aug 11 11:03:37.709698 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 11:03:37.710483 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:03:37.710483 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 11 11:03:37.710483 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 11 11:03:37.710483 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 11 11:03:37.710483 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 11 11:03:37.710483 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 11 11:03:37.710483 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 11 11:03:37.710483 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 11 11:03:37.710483 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 11 11:03:37.710483 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 11 11:03:37.710483 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 11 11:03:37.710483 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 11 11:03:37.710483 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 11 11:03:37.710483 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 11 11:03:37.710483 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 11 11:03:37.710483 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f1b06c74-0f59-489e-aa2b-5636bd1e2fdd could not be found. (HTTP 404) (Request-ID: req-ec7c46e2-b097-4af3-a4e8-c2de253d8fc7) Aug 11 11:03:37.710483 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:03:37.710483 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:03:37.710483 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:03:37.712496 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:03:37.712496 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 11 11:03:37.712496 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 11 11:03:37.712496 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 11 11:03:37.712496 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 11 11:03:37.712496 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 11 11:03:37.712496 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 11 11:03:37.712496 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 11 11:03:37.712496 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 11 11:03:37.712496 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 11 11:03:37.712496 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 11 11:03:37.712496 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 11 11:03:37.712496 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 11 11:03:37.712496 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 11 11:03:37.712496 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 11 11:03:37.712496 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 11 11:03:37.712496 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 11 11:03:37.712496 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 11 11:03:37.712496 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 11 11:03:37.715177 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 11 11:03:37.715177 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 11 11:03:37.715177 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 11 11:03:37.715177 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 11 11:03:37.715177 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f1b06c74-0f59-489e-aa2b-5636bd1e2fdd could not be found. Aug 11 11:03:37.715177 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:03:37.715177 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:03:37.715177 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:03:37.715177 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:03:37.715177 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:03:37.715177 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:03:37.715177 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 11:03:37.715177 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 11:03:37.715177 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 11 11:03:37.715177 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 11 11:03:37.715177 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 11:03:37.715177 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 11:03:37.715177 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 11 11:03:37.715177 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 11:03:37.718915 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f1b06c74-0f59-489e-aa2b-5636bd1e2fdd could not be found. Aug 11 11:03:37.718915 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:03:37.718915 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:03:37.718915 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:03:37.718915 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:03:37.718915 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:03:37.718915 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:03:37.718915 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 11:03:37.718915 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 11:03:37.718915 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f1b06c74-0f59-489e-aa2b-5636bd1e2fdd could not be found. Aug 11 11:03:37.718915 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:03:37.718915 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-92a0ee69-db5f-4483-857b-cd9a14f7964d tempest-VolumesNegativeTest-1086445182 tempest-VolumesNegativeTest-1086445182-project] Returning 404 to user: Volume f1b06c74-0f59-489e-aa2b-5636bd1e2fdd could not be found. {{(pid=121232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 11:03:37.718915 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-92a0ee69-db5f-4483-857b-cd9a14f7964d tempest-VolumesNegativeTest-1086445182 tempest-VolumesNegativeTest-1086445182-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/f1b06c74-0f59-489e-aa2b-5636bd1e2fdd" status: 404 len: 109 microversion: 2.1 time: 0.046988 Aug 11 11:03:37.718915 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 7/7] 10.222.0.48 () {58 vars in 1248 bytes} [Thu Aug 11 11:03:37 2022] DELETE /compute/v2.1/os-volumes/f1b06c74-0f59-489e-aa2b-5636bd1e2fdd => generated 109 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 11 11:03:37.733289 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-0889c8b0-1ff5-4d3f-a0c5-ff39c5da73d5 tempest-VolumesNegativeTest-1086445182 tempest-VolumesNegativeTest-1086445182-project] Calling method '.version_select at 0x7faab2a02d30>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:03:37.772307 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.wsgi [None req-0889c8b0-1ff5-4d3f-a0c5-ff39c5da73d5 tempest-VolumesNegativeTest-1086445182 tempest-VolumesNegativeTest-1086445182-project] HTTP exception thrown: Volume 9c841417-c9f5-4e64-b5f3-e8ead680f75b could not be found. Aug 11 11:03:37.772307 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-0889c8b0-1ff5-4d3f-a0c5-ff39c5da73d5 tempest-VolumesNegativeTest-1086445182 tempest-VolumesNegativeTest-1086445182-project] Request method failure captured: Aug 11 11:03:37.772307 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: request: GET /compute/v2.1/os-volumes/9c841417-c9f5-4e64-b5f3-e8ead680f75b HTTP/1.1 Aug 11 11:03:37.772307 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Accept: application/json Aug 11 11:03:37.772307 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Accept-Encoding: identity Aug 11 11:03:37.772307 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Connection: close Aug 11 11:03:37.772307 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Content-Length: 0 Aug 11 11:03:37.772307 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Content-Type: application/json Aug 11 11:03:37.772307 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Host: 10.222.0.48 Aug 11 11:03:37.772307 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Openstack-System-Scope: None Aug 11 11:03:37.772307 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: User-Agent: python-urllib3/1.26.11 Aug 11 11:03:37.772307 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Auth-Token: gAAAAABi9OIHk7HlMkM3lKXGfrRSiCNpzjT7Ucm3jN1KbzP2kWoQF07zt9pS7_ALTEzGfM7Te30JWGzgjx_-G1F_Z6TX03djJIMKuw4UfjwDBuaT0UGfKtn71IcowIX7a8MDZ1mwNLcLnePHxTAUOH9q73JvpQMINxN9B78SrWWqZfadzdaLyfw Aug 11 11:03:37.772307 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Domain-Id: None Aug 11 11:03:37.772307 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Domain-Name: None Aug 11 11:03:37.772307 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Identity-Status: Confirmed Aug 11 11:03:37.772307 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Is-Admin-Project: True Aug 11 11:03:37.772307 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Domain-Id: default Aug 11 11:03:37.772307 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Domain-Name: Default Aug 11 11:03:37.772307 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Id: 8b25b6f3331a4ad49c7312a3a4bc3154 Aug 11 11:03:37.772307 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Name: tempest-VolumesNegativeTest-1086445182 Aug 11 11:03:37.772307 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Role: reader,member Aug 11 11:03:37.772307 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Roles: reader,member Aug 11 11:03:37.785254 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b25b6f3331a4ad49c7312a3a4bc3154"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/8b25b6f3331a4ad49c7312a3a4bc3154"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/8b25b6f3331a4ad49c7312a3a4bc3154"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_8b25b6f3331a4ad49c7312a3a4bc3154", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] Aug 11 11:03:37.785254 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Tenant: tempest-VolumesNegativeTest-1086445182 Aug 11 11:03:37.785254 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Tenant-Id: 8b25b6f3331a4ad49c7312a3a4bc3154 Aug 11 11:03:37.785254 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Tenant-Name: tempest-VolumesNegativeTest-1086445182 Aug 11 11:03:37.785254 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User: tempest-VolumesNegativeTest-1086445182-project Aug 11 11:03:37.785254 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Domain-Id: default Aug 11 11:03:37.785254 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Domain-Name: Default Aug 11 11:03:37.785254 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Id: 7571d52d0a1f4aa4a9d0dd6dfe2c7a76 Aug 11 11:03:37.785254 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Name: tempest-VolumesNegativeTest-1086445182-project Aug 11 11:03:37.785254 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: method: Aug 11 11:03:37.785254 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: exception: Volume 9c841417-c9f5-4e64-b5f3-e8ead680f75b could not be found. Aug 11 11:03:37.785254 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: action_args: {'id': '9c841417-c9f5-4e64-b5f3-e8ead680f75b'} Aug 11 11:03:37.785254 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 11:03:37.787583 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:03:37.787583 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 11 11:03:37.787583 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 11 11:03:37.787583 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 11 11:03:37.787583 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 11 11:03:37.787583 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 11 11:03:37.787583 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 11 11:03:37.787583 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 11 11:03:37.787583 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 11 11:03:37.787583 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 11 11:03:37.787583 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 11 11:03:37.787583 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 11 11:03:37.787583 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 11 11:03:37.787583 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 11 11:03:37.787583 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 11 11:03:37.787583 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9c841417-c9f5-4e64-b5f3-e8ead680f75b could not be found. (HTTP 404) (Request-ID: req-3b5dc312-594b-4ddf-bf6d-c9cbc6ef540e) Aug 11 11:03:37.787583 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:03:37.787583 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:03:37.787583 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:03:37.790672 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:03:37.790672 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 11 11:03:37.790672 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 11 11:03:37.790672 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 11 11:03:37.790672 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 11 11:03:37.790672 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 11 11:03:37.790672 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 11 11:03:37.790672 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 11 11:03:37.790672 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 11 11:03:37.790672 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 11 11:03:37.790672 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 11 11:03:37.790672 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 11 11:03:37.790672 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 11 11:03:37.790672 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 11 11:03:37.790672 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 11 11:03:37.790672 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 11 11:03:37.790672 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 11 11:03:37.790672 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 11 11:03:37.790672 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 11 11:03:37.793283 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 11 11:03:37.793283 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 11 11:03:37.793283 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 11 11:03:37.793283 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 11 11:03:37.793283 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9c841417-c9f5-4e64-b5f3-e8ead680f75b could not be found. Aug 11 11:03:37.793283 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:03:37.793283 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:03:37.793283 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:03:37.793283 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:03:37.793283 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:03:37.793283 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:03:37.793283 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 11:03:37.793283 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 11:03:37.793283 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 11 11:03:37.793283 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 11 11:03:37.793283 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 11:03:37.793283 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 11:03:37.793283 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 11 11:03:37.793283 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 11:03:37.797574 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9c841417-c9f5-4e64-b5f3-e8ead680f75b could not be found. Aug 11 11:03:37.797574 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:03:37.797574 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:03:37.797574 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:03:37.797574 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:03:37.797574 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:03:37.797574 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:03:37.797574 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 11:03:37.797574 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 11:03:37.797574 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9c841417-c9f5-4e64-b5f3-e8ead680f75b could not be found. Aug 11 11:03:37.797574 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:03:37.797574 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-0889c8b0-1ff5-4d3f-a0c5-ff39c5da73d5 tempest-VolumesNegativeTest-1086445182 tempest-VolumesNegativeTest-1086445182-project] Returning 404 to user: Volume 9c841417-c9f5-4e64-b5f3-e8ead680f75b could not be found. {{(pid=121232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 11:03:37.797574 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-0889c8b0-1ff5-4d3f-a0c5-ff39c5da73d5 tempest-VolumesNegativeTest-1086445182 tempest-VolumesNegativeTest-1086445182-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/9c841417-c9f5-4e64-b5f3-e8ead680f75b" status: 404 len: 109 microversion: 2.1 time: 0.055319 Aug 11 11:03:37.797574 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 8/8] 10.222.0.48 () {58 vars in 1245 bytes} [Thu Aug 11 11:03:37 2022] GET /compute/v2.1/os-volumes/9c841417-c9f5-4e64-b5f3-e8ead680f75b => generated 109 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 11:03:39.561183 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-c2a204a2-097d-41c8-8073-d8745e0e1ceb tempest-VolumesSnapshotsTestJSON-1424857693 tempest-VolumesSnapshotsTestJSON-1424857693-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 2.902041 Aug 11 11:03:39.562250 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 1/9] 10.222.0.48 () {60 vars in 1155 bytes} [Thu Aug 11 11:03:36 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 2905 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 11 11:03:39.578878 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-dce9e01d-2f5d-49ab-bfac-3cd7add8a5b5 tempest-VolumesSnapshotsTestJSON-1424857693 tempest-VolumesSnapshotsTestJSON-1424857693-project] Calling method '.version_select at 0x7faab2adf790>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:03:39.635410 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-d4d8b942-c905-473c-a60d-084cbc39c36e tempest-VolumesTestJSON-626122830 tempest-VolumesTestJSON-626122830-project] Calling method '.version_select at 0x7faab2a73ca0>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:03:39.646481 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-dce9e01d-2f5d-49ab-bfac-3cd7add8a5b5 tempest-VolumesSnapshotsTestJSON-1424857693 tempest-VolumesSnapshotsTestJSON-1424857693-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/96726e60-b940-49dc-8c29-25083c498cc7" status: 200 len: 344 microversion: 2.1 time: 0.073008 Aug 11 11:03:39.647223 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 9/10] 10.222.0.48 () {58 vars in 1245 bytes} [Thu Aug 11 11:03:39 2022] GET /compute/v2.1/os-volumes/96726e60-b940-49dc-8c29-25083c498cc7 => generated 344 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:03:39.747472 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-d4d8b942-c905-473c-a60d-084cbc39c36e tempest-VolumesTestJSON-626122830 tempest-VolumesTestJSON-626122830-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/3fac1aa1-ab1f-4d5e-af20-06b2db5e367c" status: 200 len: 351 microversion: 2.1 time: 0.117235 Aug 11 11:03:39.756437 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 2/11] 10.222.0.48 () {58 vars in 1245 bytes} [Thu Aug 11 11:03:39 2022] GET /compute/v2.1/os-volumes/3fac1aa1-ab1f-4d5e-af20-06b2db5e367c => generated 351 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 11:03:40.666278 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-f5b7c162-67e4-4b50-8883-93e0572a5027 tempest-VolumesSnapshotsTestJSON-1424857693 tempest-VolumesSnapshotsTestJSON-1424857693-project] Calling method '.version_select at 0x7faab2a020d0>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:03:41.063134 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-f5b7c162-67e4-4b50-8883-93e0572a5027 tempest-VolumesSnapshotsTestJSON-1424857693 tempest-VolumesSnapshotsTestJSON-1424857693-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/96726e60-b940-49dc-8c29-25083c498cc7" status: 200 len: 345 microversion: 2.1 time: 0.399545 Aug 11 11:03:41.063134 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 10/12] 10.222.0.48 () {58 vars in 1245 bytes} [Thu Aug 11 11:03:40 2022] GET /compute/v2.1/os-volumes/96726e60-b940-49dc-8c29-25083c498cc7 => generated 345 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:03:41.076069 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-c85d8c77-e580-478f-b0ab-9cbf32c84966 tempest-VolumesSnapshotsTestJSON-1424857693 tempest-VolumesSnapshotsTestJSON-1424857693-project] Action: 'create', calling method: .version_select at 0x7faab2a883a0>, body: {"snapshot": {"volume_id": "96726e60-b940-49dc-8c29-25083c498cc7", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1364750190"}} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:03:41.731012 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-41cff263-b838-4959-be65-f3944540dae8 tempest-VolumesTestJSON-626122830 tempest-VolumesTestJSON-626122830-project] Calling method '.version_select at 0x7faab2a1d280>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:03:41.872107 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-c85d8c77-e580-478f-b0ab-9cbf32c84966 tempest-VolumesSnapshotsTestJSON-1424857693 tempest-VolumesSnapshotsTestJSON-1424857693-project] 10.222.0.48 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.800537 Aug 11 11:03:41.873374 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 3/13] 10.222.0.48 () {60 vars in 1162 bytes} [Thu Aug 11 11:03:41 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:03:41.884133 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-3e088594-e34e-4b64-b37e-85fdc145fb64 tempest-VolumesSnapshotsTestJSON-1424857693 tempest-VolumesSnapshotsTestJSON-1424857693-project] Calling method '.version_select at 0x7faab2a8c4c0>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:03:41.944839 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-41cff263-b838-4959-be65-f3944540dae8 tempest-VolumesTestJSON-626122830 tempest-VolumesTestJSON-626122830-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/ffd47eaf-1472-4c38-97d7-aabe41a641d7" status: 200 len: 350 microversion: 2.1 time: 0.217641 Aug 11 11:03:41.955299 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 11/14] 10.222.0.48 () {58 vars in 1245 bytes} [Thu Aug 11 11:03:41 2022] GET /compute/v2.1/os-volumes/ffd47eaf-1472-4c38-97d7-aabe41a641d7 => generated 350 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:03:42.087200 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-3e088594-e34e-4b64-b37e-85fdc145fb64 tempest-VolumesSnapshotsTestJSON-1424857693 tempest-VolumesSnapshotsTestJSON-1424857693-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/9050f652-7f0e-4129-b85c-f774d0de7215" status: 200 len: 287 microversion: 2.1 time: 0.207270 Aug 11 11:03:42.088606 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 4/15] 10.222.0.48 () {58 vars in 1251 bytes} [Thu Aug 11 11:03:41 2022] GET /compute/v2.1/os-snapshots/9050f652-7f0e-4129-b85c-f774d0de7215 => generated 287 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:03:42.101079 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-9fc3823d-37a7-4fab-8579-7d7795fcd3b8 tempest-VolumesSnapshotsTestJSON-1424857693 tempest-VolumesSnapshotsTestJSON-1424857693-project] Calling method '.version_select at 0x7faab2a1d940>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:03:42.330709 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-9fc3823d-37a7-4fab-8579-7d7795fcd3b8 tempest-VolumesSnapshotsTestJSON-1424857693 tempest-VolumesSnapshotsTestJSON-1424857693-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.234797 Aug 11 11:03:42.331442 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 12/16] 10.222.0.48 () {58 vars in 1140 bytes} [Thu Aug 11 11:03:42 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 11:03:42.343238 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-e99404ce-914c-474a-a067-1b3014760276 tempest-VolumesSnapshotsTestJSON-1424857693 tempest-VolumesSnapshotsTestJSON-1424857693-project] Calling method '.version_select at 0x7faab2a88c10>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:03:42.657256 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-e99404ce-914c-474a-a067-1b3014760276 tempest-VolumesSnapshotsTestJSON-1424857693 tempest-VolumesSnapshotsTestJSON-1424857693-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/9050f652-7f0e-4129-b85c-f774d0de7215" status: 200 len: 287 microversion: 2.1 time: 0.318554 Aug 11 11:03:42.658191 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 5/17] 10.222.0.48 () {58 vars in 1251 bytes} [Thu Aug 11 11:03:42 2022] GET /compute/v2.1/os-snapshots/9050f652-7f0e-4129-b85c-f774d0de7215 => generated 287 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:03:43.670131 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-c76ad0f2-0c77-486f-9610-2ec2a458fc51 tempest-VolumesSnapshotsTestJSON-1424857693 tempest-VolumesSnapshotsTestJSON-1424857693-project] Calling method '.version_select at 0x7faab2a1d820>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:03:43.717785 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-c76ad0f2-0c77-486f-9610-2ec2a458fc51 tempest-VolumesSnapshotsTestJSON-1424857693 tempest-VolumesSnapshotsTestJSON-1424857693-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/9050f652-7f0e-4129-b85c-f774d0de7215" status: 200 len: 287 microversion: 2.1 time: 0.050818 Aug 11 11:03:43.718483 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 13/18] 10.222.0.48 () {58 vars in 1251 bytes} [Thu Aug 11 11:03:43 2022] GET /compute/v2.1/os-snapshots/9050f652-7f0e-4129-b85c-f774d0de7215 => generated 287 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 11:03:44.732444 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-17ed2e52-9a62-4699-b99b-33964af9582b tempest-VolumesSnapshotsTestJSON-1424857693 tempest-VolumesSnapshotsTestJSON-1424857693-project] Calling method '.version_select at 0x7faab2a884c0>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:03:44.823092 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-17ed2e52-9a62-4699-b99b-33964af9582b tempest-VolumesSnapshotsTestJSON-1424857693 tempest-VolumesSnapshotsTestJSON-1424857693-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/9050f652-7f0e-4129-b85c-f774d0de7215" status: 200 len: 287 microversion: 2.1 time: 0.095875 Aug 11 11:03:44.824196 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 6/19] 10.222.0.48 () {58 vars in 1251 bytes} [Thu Aug 11 11:03:44 2022] GET /compute/v2.1/os-snapshots/9050f652-7f0e-4129-b85c-f774d0de7215 => generated 287 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:03:45.842113 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-bbdc9b04-db81-489f-91cd-f277ca083830 tempest-VolumesSnapshotsTestJSON-1424857693 tempest-VolumesSnapshotsTestJSON-1424857693-project] Calling method '.version_select at 0x7faab2a1d0d0>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:03:45.889624 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-bbdc9b04-db81-489f-91cd-f277ca083830 tempest-VolumesSnapshotsTestJSON-1424857693 tempest-VolumesSnapshotsTestJSON-1424857693-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/9050f652-7f0e-4129-b85c-f774d0de7215" status: 200 len: 288 microversion: 2.1 time: 0.056269 Aug 11 11:03:45.890682 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 14/20] 10.222.0.48 () {58 vars in 1251 bytes} [Thu Aug 11 11:03:45 2022] GET /compute/v2.1/os-snapshots/9050f652-7f0e-4129-b85c-f774d0de7215 => generated 288 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:03:45.901669 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-9f6c9684-d0c3-41c1-ac87-2016050b7c7f tempest-VolumesSnapshotsTestJSON-1424857693 tempest-VolumesSnapshotsTestJSON-1424857693-project] Calling method '.version_select at 0x7faab2a73dc0>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:03:46.179188 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-9f6c9684-d0c3-41c1-ac87-2016050b7c7f tempest-VolumesSnapshotsTestJSON-1424857693 tempest-VolumesSnapshotsTestJSON-1424857693-project] 10.222.0.48 "DELETE /compute/v2.1/os-snapshots/9050f652-7f0e-4129-b85c-f774d0de7215" status: 202 len: 0 microversion: 2.1 time: 0.280804 Aug 11 11:03:46.180398 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 7/21] 10.222.0.48 () {58 vars in 1254 bytes} [Thu Aug 11 11:03:45 2022] DELETE /compute/v2.1/os-snapshots/9050f652-7f0e-4129-b85c-f774d0de7215 => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 11:03:46.196442 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-7ec89807-842e-4ae0-8cb2-d096866abd51 tempest-VolumesSnapshotsTestJSON-1424857693 tempest-VolumesSnapshotsTestJSON-1424857693-project] Calling method '.version_select at 0x7faab2a73d30>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:03:46.302514 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-2a87d02c-2b7a-4985-8d9a-0acb42de00dc tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Action: 'create', calling method: .version_select at 0x7faab2a024c0>, body: {"keypair": {"name": "tempest-keypair-839198739", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEst8Dq4sYzX7TgWWB+jUq0KsTkxl1bIKucTl6n5CQt6HMDY1iXOSZfVI+PFcyAG14V70wOZX2OgSaffw7mPjKjIwUUM5/H+dRTyb7vfqNEsjMc1/lt1pDn2znaqXGoyPQ=="}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:03:46.308268 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-7ec89807-842e-4ae0-8cb2-d096866abd51 tempest-VolumesSnapshotsTestJSON-1424857693 tempest-VolumesSnapshotsTestJSON-1424857693-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/9050f652-7f0e-4129-b85c-f774d0de7215" status: 200 len: 287 microversion: 2.1 time: 0.123135 Aug 11 11:03:46.308930 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 8/22] 10.222.0.48 () {58 vars in 1251 bytes} [Thu Aug 11 11:03:46 2022] GET /compute/v2.1/os-snapshots/9050f652-7f0e-4129-b85c-f774d0de7215 => generated 287 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:03:46.340813 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-49fd44e1-022f-4d2c-8de5-8164f6bd9b81 tempest-VolumesTestJSON-626122830 tempest-VolumesTestJSON-626122830-project] Calling method '.version_select at 0x7faab2a883a0>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:03:46.424100 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-2a87d02c-2b7a-4985-8d9a-0acb42de00dc tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Getting quotas for project b0b3799012d24fad98d155e3b000fc22. Resources: {'key_pairs'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 11:03:46.432569 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-2a87d02c-2b7a-4985-8d9a-0acb42de00dc tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Getting quotas for user bb18a00d44ed4af186bdc589e1e14e22 and project b0b3799012d24fad98d155e3b000fc22. Resources: {'key_pairs'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 11:03:46.449374 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-49fd44e1-022f-4d2c-8de5-8164f6bd9b81 tempest-VolumesTestJSON-626122830 tempest-VolumesTestJSON-626122830-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/3dbd5178-ebaa-4d10-9783-46d0193508d6" status: 200 len: 351 microversion: 2.1 time: 0.115156 Aug 11 11:03:46.458853 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 9/23] 10.222.0.48 () {58 vars in 1245 bytes} [Thu Aug 11 11:03:46 2022] GET /compute/v2.1/os-volumes/3dbd5178-ebaa-4d10-9783-46d0193508d6 => generated 351 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 11:03:46.465344 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-395f7896-db3a-4207-829d-b12ab65e3c0f tempest-VolumesTestJSON-626122830 tempest-VolumesTestJSON-626122830-project] Calling method '.version_select at 0x7faab2a88ca0>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:03:46.592567 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-395f7896-db3a-4207-829d-b12ab65e3c0f tempest-VolumesTestJSON-626122830 tempest-VolumesTestJSON-626122830-project] 10.222.0.48 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.132054 Aug 11 11:03:46.602127 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 10/24] 10.222.0.48 () {58 vars in 1134 bytes} [Thu Aug 11 11:03:46 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:03:46.618926 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-d3b6b039-784c-4ff4-a960-ba49e65acab8 tempest-VolumesTestJSON-626122830 tempest-VolumesTestJSON-626122830-project] Calling method '.version_select at 0x7faab2a88e50>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:03:46.656922 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-2a87d02c-2b7a-4985-8d9a-0acb42de00dc tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.649906 Aug 11 11:03:46.658276 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 15/25] 10.222.0.48 () {60 vars in 1159 bytes} [Thu Aug 11 11:03:46 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 11:03:46.859826 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-d3b6b039-784c-4ff4-a960-ba49e65acab8 tempest-VolumesTestJSON-626122830 tempest-VolumesTestJSON-626122830-project] 10.222.0.48 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.255854 Aug 11 11:03:46.873621 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 11/26] 10.222.0.48 () {58 vars in 1149 bytes} [Thu Aug 11 11:03:46 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:03:46.875195 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-9faaa931-8d7d-4d90-8bc4-527675f61471 tempest-VolumesTestJSON-626122830 tempest-VolumesTestJSON-626122830-project] Calling method '.version_select at 0x7faab2973040>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:03:47.130067 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-9faaa931-8d7d-4d90-8bc4-527675f61471 tempest-VolumesTestJSON-626122830 tempest-VolumesTestJSON-626122830-project] 10.222.0.48 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.259376 Aug 11 11:03:47.143498 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 16/27] 10.222.0.48 () {58 vars in 1134 bytes} [Thu Aug 11 11:03:46 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:03:47.144845 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-97e92f8a-2a34-44df-b72f-402ddb9a00e4 tempest-VolumesTestJSON-626122830 tempest-VolumesTestJSON-626122830-project] Calling method '.version_select at 0x7faab2a73c10>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:03:47.321115 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-994d602c-3314-4950-883b-72e668e38758 tempest-VolumesSnapshotsTestJSON-1424857693 tempest-VolumesSnapshotsTestJSON-1424857693-project] Calling method '.version_select at 0x7faab29a48b0>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:03:47.347664 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-97e92f8a-2a34-44df-b72f-402ddb9a00e4 tempest-VolumesTestJSON-626122830 tempest-VolumesTestJSON-626122830-project] 10.222.0.48 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.207811 Aug 11 11:03:47.348257 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 12/28] 10.222.0.48 () {58 vars in 1167 bytes} [Thu Aug 11 11:03:47 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 11:03:47.361981 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-4a9ca231-e9aa-456a-9c17-79a98cfc85e1 tempest-VolumesTestJSON-626122830 tempest-VolumesTestJSON-626122830-project] Calling method '.version_select at 0x7faab2aa2280>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:03:47.377464 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.wsgi [None req-994d602c-3314-4950-883b-72e668e38758 tempest-VolumesSnapshotsTestJSON-1424857693 tempest-VolumesSnapshotsTestJSON-1424857693-project] HTTP exception thrown: Snapshot 9050f652-7f0e-4129-b85c-f774d0de7215 could not be found. Aug 11 11:03:47.377464 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-994d602c-3314-4950-883b-72e668e38758 tempest-VolumesSnapshotsTestJSON-1424857693 tempest-VolumesSnapshotsTestJSON-1424857693-project] Request method failure captured: Aug 11 11:03:47.377464 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: request: GET /compute/v2.1/os-snapshots/9050f652-7f0e-4129-b85c-f774d0de7215 HTTP/1.1 Aug 11 11:03:47.377464 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Accept: application/json Aug 11 11:03:47.377464 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Accept-Encoding: identity Aug 11 11:03:47.377464 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Connection: close Aug 11 11:03:47.377464 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Content-Length: 0 Aug 11 11:03:47.377464 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Content-Type: application/json Aug 11 11:03:47.377464 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Host: 10.222.0.48 Aug 11 11:03:47.377464 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Openstack-System-Scope: None Aug 11 11:03:47.377464 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: User-Agent: python-urllib3/1.26.11 Aug 11 11:03:47.377464 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Auth-Token: gAAAAABi9OIIfTcysMm5yotVwfi3vAh83gRSL3xD9i3_0VtsJMR9clou3gxye2gI7twp6ABoYnJ21VN8SDi8-ubWojKfgg1gjAIXIEwBDVqnDk7V4Qevj5oxJnMuBvk7otP3snn-zAC6Dk1IOi6SLYM8jEper7WAj1FbM7Kk_99pvQ7Y1QofWp0 Aug 11 11:03:47.377464 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Domain-Id: None Aug 11 11:03:47.377464 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Domain-Name: None Aug 11 11:03:47.377464 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Identity-Status: Confirmed Aug 11 11:03:47.377464 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Is-Admin-Project: True Aug 11 11:03:47.377464 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Domain-Id: default Aug 11 11:03:47.377464 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Domain-Name: Default Aug 11 11:03:47.377464 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Id: d11d73b282114c02bed69938677e2e58 Aug 11 11:03:47.377464 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1424857693 Aug 11 11:03:47.377464 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Role: reader,member Aug 11 11:03:47.377464 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Roles: reader,member Aug 11 11:03:47.378717 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d11d73b282114c02bed69938677e2e58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d11d73b282114c02bed69938677e2e58"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d11d73b282114c02bed69938677e2e58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d11d73b282114c02bed69938677e2e58", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] Aug 11 11:03:47.378717 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1424857693 Aug 11 11:03:47.378717 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Tenant-Id: d11d73b282114c02bed69938677e2e58 Aug 11 11:03:47.378717 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1424857693 Aug 11 11:03:47.378717 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User: tempest-VolumesSnapshotsTestJSON-1424857693-project Aug 11 11:03:47.378717 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Domain-Id: default Aug 11 11:03:47.378717 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Domain-Name: Default Aug 11 11:03:47.378717 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Id: b226ddd101ae4ff9aeab0fc797a349f5 Aug 11 11:03:47.378717 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1424857693-project Aug 11 11:03:47.378717 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: method: Aug 11 11:03:47.378717 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: exception: Snapshot 9050f652-7f0e-4129-b85c-f774d0de7215 could not be found. Aug 11 11:03:47.378717 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: action_args: {'id': '9050f652-7f0e-4129-b85c-f774d0de7215'} Aug 11 11:03:47.378717 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 11:03:47.379393 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:03:47.379393 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 11 11:03:47.379393 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 11 11:03:47.379393 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 11 11:03:47.379393 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 11 11:03:47.379393 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 11 11:03:47.379393 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 11 11:03:47.379393 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 11 11:03:47.379393 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 11 11:03:47.379393 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 11 11:03:47.379393 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 11 11:03:47.379393 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 11 11:03:47.379393 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 11 11:03:47.379393 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 11 11:03:47.379393 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 11 11:03:47.379393 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 9050f652-7f0e-4129-b85c-f774d0de7215 could not be found. (HTTP 404) (Request-ID: req-5619d683-3a3b-43b9-95fa-5fbacb3cbf71) Aug 11 11:03:47.379393 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:03:47.379393 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:03:47.380282 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:03:47.380282 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:03:47.380282 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 11 11:03:47.380282 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 11 11:03:47.380282 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 11 11:03:47.380282 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 11 11:03:47.380282 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 11 11:03:47.380282 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 11 11:03:47.380282 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 11 11:03:47.380282 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 11 11:03:47.380282 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 11 11:03:47.380282 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 11 11:03:47.380282 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 11 11:03:47.380282 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 11 11:03:47.380282 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 11 11:03:47.380282 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 11 11:03:47.380282 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 11 11:03:47.380282 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 11 11:03:47.380282 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 11 11:03:47.381226 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 11 11:03:47.381226 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 11 11:03:47.381226 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 11 11:03:47.381226 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 11 11:03:47.381226 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 11 11:03:47.381226 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 9050f652-7f0e-4129-b85c-f774d0de7215 could not be found. Aug 11 11:03:47.381226 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:03:47.381226 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:03:47.381226 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:03:47.381226 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:03:47.381226 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:03:47.381226 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:03:47.381226 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 11:03:47.381226 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 11:03:47.381226 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 11 11:03:47.381226 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 11 11:03:47.381226 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 11:03:47.381226 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 11:03:47.381226 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 11 11:03:47.381226 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 11:03:47.382196 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 9050f652-7f0e-4129-b85c-f774d0de7215 could not be found. Aug 11 11:03:47.382196 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:03:47.382196 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:03:47.382196 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:03:47.382196 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:03:47.382196 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:03:47.382196 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:03:47.382196 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 11:03:47.382196 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 11:03:47.382196 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 9050f652-7f0e-4129-b85c-f774d0de7215 could not be found. Aug 11 11:03:47.382196 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:03:47.382196 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-994d602c-3314-4950-883b-72e668e38758 tempest-VolumesSnapshotsTestJSON-1424857693 tempest-VolumesSnapshotsTestJSON-1424857693-project] Returning 404 to user: Snapshot 9050f652-7f0e-4129-b85c-f774d0de7215 could not be found. {{(pid=121232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 11:03:47.382196 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-994d602c-3314-4950-883b-72e668e38758 tempest-VolumesSnapshotsTestJSON-1424857693 tempest-VolumesSnapshotsTestJSON-1424857693-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/9050f652-7f0e-4129-b85c-f774d0de7215" status: 404 len: 111 microversion: 2.1 time: 0.059467 Aug 11 11:03:47.390185 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 17/29] 10.222.0.48 () {58 vars in 1251 bytes} [Thu Aug 11 11:03:47 2022] GET /compute/v2.1/os-snapshots/9050f652-7f0e-4129-b85c-f774d0de7215 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 11 11:03:47.414564 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-93975b0b-78cf-4409-8a12-c4126c60f509 tempest-VolumesSnapshotsTestJSON-1424857693 tempest-VolumesSnapshotsTestJSON-1424857693-project] Calling method '.version_select at 0x7faab2973790>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:03:47.552445 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-4a9ca231-e9aa-456a-9c17-79a98cfc85e1 tempest-VolumesTestJSON-626122830 tempest-VolumesTestJSON-626122830-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.194623 Aug 11 11:03:47.562274 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 13/30] 10.222.0.48 () {58 vars in 1170 bytes} [Thu Aug 11 11:03:47 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:03:47.567426 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-63a0aded-082c-4fed-86d5-855485617dd7 tempest-VolumesTestJSON-626122830 tempest-VolumesTestJSON-626122830-project] Calling method '.version_select at 0x7faab2a888b0>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:03:47.720331 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-63a0aded-082c-4fed-86d5-855485617dd7 tempest-VolumesTestJSON-626122830 tempest-VolumesTestJSON-626122830-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.155014 Aug 11 11:03:47.720331 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 14/31] 10.222.0.48 () {58 vars in 1155 bytes} [Thu Aug 11 11:03:47 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:03:47.731316 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-93975b0b-78cf-4409-8a12-c4126c60f509 tempest-VolumesSnapshotsTestJSON-1424857693 tempest-VolumesSnapshotsTestJSON-1424857693-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/96726e60-b940-49dc-8c29-25083c498cc7" status: 202 len: 0 microversion: 2.1 time: 0.336275 Aug 11 11:03:47.732475 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 18/32] 10.222.0.48 () {58 vars in 1248 bytes} [Thu Aug 11 11:03:47 2022] DELETE /compute/v2.1/os-volumes/96726e60-b940-49dc-8c29-25083c498cc7 => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 11:03:47.744847 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-c5604acf-4990-4941-9451-be9f08a42c5c tempest-VolumesSnapshotsTestJSON-1424857693 tempest-VolumesSnapshotsTestJSON-1424857693-project] Calling method '.version_select at 0x7faab29a4940>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:03:47.747942 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-1bea53b5-f650-454e-b2af-108f15445b5e tempest-VolumesTestJSON-626122830 tempest-VolumesTestJSON-626122830-project] Calling method '.version_select at 0x7faab2a8cb80>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:03:47.818570 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-c5604acf-4990-4941-9451-be9f08a42c5c tempest-VolumesSnapshotsTestJSON-1424857693 tempest-VolumesSnapshotsTestJSON-1424857693-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/96726e60-b940-49dc-8c29-25083c498cc7" status: 200 len: 344 microversion: 2.1 time: 0.081990 Aug 11 11:03:47.819818 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 19/33] 10.222.0.48 () {58 vars in 1245 bytes} [Thu Aug 11 11:03:47 2022] GET /compute/v2.1/os-volumes/96726e60-b940-49dc-8c29-25083c498cc7 => generated 344 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:03:47.943351 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-1bea53b5-f650-454e-b2af-108f15445b5e tempest-VolumesTestJSON-626122830 tempest-VolumesTestJSON-626122830-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.214315 Aug 11 11:03:47.943955 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 15/34] 10.222.0.48 () {58 vars in 1188 bytes} [Thu Aug 11 11:03:47 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 11:03:47.957125 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-95ed6cc3-6d9b-404c-a47d-1021dfce388c tempest-VolumesTestJSON-626122830 tempest-VolumesTestJSON-626122830-project] Calling method '.version_select at 0x7faab29a4280>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:03:48.127259 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-95ed6cc3-6d9b-404c-a47d-1021dfce388c tempest-VolumesTestJSON-626122830 tempest-VolumesTestJSON-626122830-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.173799 Aug 11 11:03:48.127845 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 20/35] 10.222.0.48 () {58 vars in 1155 bytes} [Thu Aug 11 11:03:47 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:03:48.836997 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-a1a55529-a7b2-401b-8a18-9acac2b1b8dd tempest-VolumesSnapshotsTestJSON-1424857693 tempest-VolumesSnapshotsTestJSON-1424857693-project] Calling method '.version_select at 0x7faab2aa2f70>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:03:48.909004 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.wsgi [None req-a1a55529-a7b2-401b-8a18-9acac2b1b8dd tempest-VolumesSnapshotsTestJSON-1424857693 tempest-VolumesSnapshotsTestJSON-1424857693-project] HTTP exception thrown: Volume 96726e60-b940-49dc-8c29-25083c498cc7 could not be found. Aug 11 11:03:48.913823 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-a1a55529-a7b2-401b-8a18-9acac2b1b8dd tempest-VolumesSnapshotsTestJSON-1424857693 tempest-VolumesSnapshotsTestJSON-1424857693-project] Request method failure captured: Aug 11 11:03:48.913823 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: request: GET /compute/v2.1/os-volumes/96726e60-b940-49dc-8c29-25083c498cc7 HTTP/1.1 Aug 11 11:03:48.913823 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Accept: application/json Aug 11 11:03:48.913823 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Accept-Encoding: identity Aug 11 11:03:48.913823 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Connection: close Aug 11 11:03:48.913823 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Content-Length: 0 Aug 11 11:03:48.913823 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Content-Type: application/json Aug 11 11:03:48.913823 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Host: 10.222.0.48 Aug 11 11:03:48.913823 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Openstack-System-Scope: None Aug 11 11:03:48.913823 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: User-Agent: python-urllib3/1.26.11 Aug 11 11:03:48.913823 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Auth-Token: gAAAAABi9OIIfTcysMm5yotVwfi3vAh83gRSL3xD9i3_0VtsJMR9clou3gxye2gI7twp6ABoYnJ21VN8SDi8-ubWojKfgg1gjAIXIEwBDVqnDk7V4Qevj5oxJnMuBvk7otP3snn-zAC6Dk1IOi6SLYM8jEper7WAj1FbM7Kk_99pvQ7Y1QofWp0 Aug 11 11:03:48.913823 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Domain-Id: None Aug 11 11:03:48.913823 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Domain-Name: None Aug 11 11:03:48.913823 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Identity-Status: Confirmed Aug 11 11:03:48.913823 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Is-Admin-Project: True Aug 11 11:03:48.913823 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Domain-Id: default Aug 11 11:03:48.913823 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Domain-Name: Default Aug 11 11:03:48.913823 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Id: d11d73b282114c02bed69938677e2e58 Aug 11 11:03:48.913823 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1424857693 Aug 11 11:03:48.913823 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Role: reader,member Aug 11 11:03:48.913823 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Roles: reader,member Aug 11 11:03:48.914932 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d11d73b282114c02bed69938677e2e58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d11d73b282114c02bed69938677e2e58"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d11d73b282114c02bed69938677e2e58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d11d73b282114c02bed69938677e2e58", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] Aug 11 11:03:48.914932 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1424857693 Aug 11 11:03:48.914932 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant-Id: d11d73b282114c02bed69938677e2e58 Aug 11 11:03:48.914932 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1424857693 Aug 11 11:03:48.914932 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User: tempest-VolumesSnapshotsTestJSON-1424857693-project Aug 11 11:03:48.914932 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Domain-Id: default Aug 11 11:03:48.914932 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Domain-Name: Default Aug 11 11:03:48.914932 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Id: b226ddd101ae4ff9aeab0fc797a349f5 Aug 11 11:03:48.914932 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1424857693-project Aug 11 11:03:48.914932 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: method: Aug 11 11:03:48.914932 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: exception: Volume 96726e60-b940-49dc-8c29-25083c498cc7 could not be found. Aug 11 11:03:48.914932 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: action_args: {'id': '96726e60-b940-49dc-8c29-25083c498cc7'} Aug 11 11:03:48.914932 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 11:03:48.915715 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:03:48.915715 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 11 11:03:48.915715 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 11 11:03:48.915715 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 11 11:03:48.915715 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 11 11:03:48.915715 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 11 11:03:48.915715 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 11 11:03:48.915715 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 11 11:03:48.915715 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 11 11:03:48.915715 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 11 11:03:48.915715 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 11 11:03:48.915715 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 11 11:03:48.915715 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 11 11:03:48.915715 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 11 11:03:48.915715 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 11 11:03:48.915715 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 96726e60-b940-49dc-8c29-25083c498cc7 could not be found. (HTTP 404) (Request-ID: req-2dc48308-d361-49d0-9805-32fd97a5f5d9) Aug 11 11:03:48.915715 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:03:48.915715 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:03:48.915715 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:03:48.916702 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:03:48.916702 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 11 11:03:48.916702 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 11 11:03:48.916702 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 11 11:03:48.916702 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 11 11:03:48.916702 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 11 11:03:48.916702 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 11 11:03:48.916702 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 11 11:03:48.916702 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 11 11:03:48.916702 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 11 11:03:48.916702 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 11 11:03:48.916702 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 11 11:03:48.916702 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 11 11:03:48.916702 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 11 11:03:48.916702 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 11 11:03:48.916702 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 11 11:03:48.916702 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 11 11:03:48.916702 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 11 11:03:48.916702 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 11 11:03:48.920623 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 11 11:03:48.920623 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 11 11:03:48.920623 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 11 11:03:48.920623 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 11 11:03:48.920623 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 96726e60-b940-49dc-8c29-25083c498cc7 could not be found. Aug 11 11:03:48.920623 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:03:48.920623 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:03:48.920623 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:03:48.920623 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:03:48.920623 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:03:48.920623 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:03:48.920623 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 11:03:48.920623 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 11:03:48.920623 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 11 11:03:48.920623 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 11 11:03:48.920623 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 11:03:48.920623 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 11:03:48.920623 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 11 11:03:48.920623 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 11:03:48.922978 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 96726e60-b940-49dc-8c29-25083c498cc7 could not be found. Aug 11 11:03:48.922978 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:03:48.922978 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:03:48.922978 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:03:48.922978 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:03:48.922978 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:03:48.922978 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:03:48.922978 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 11:03:48.922978 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 11:03:48.922978 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 96726e60-b940-49dc-8c29-25083c498cc7 could not be found. Aug 11 11:03:48.922978 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:03:48.922978 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-a1a55529-a7b2-401b-8a18-9acac2b1b8dd tempest-VolumesSnapshotsTestJSON-1424857693 tempest-VolumesSnapshotsTestJSON-1424857693-project] Returning 404 to user: Volume 96726e60-b940-49dc-8c29-25083c498cc7 could not be found. {{(pid=121231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 11:03:48.922978 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-a1a55529-a7b2-401b-8a18-9acac2b1b8dd tempest-VolumesSnapshotsTestJSON-1424857693 tempest-VolumesSnapshotsTestJSON-1424857693-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/96726e60-b940-49dc-8c29-25083c498cc7" status: 404 len: 109 microversion: 2.1 time: 0.085544 Aug 11 11:03:48.922978 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 16/36] 10.222.0.48 () {58 vars in 1245 bytes} [Thu Aug 11 11:03:48 2022] GET /compute/v2.1/os-volumes/96726e60-b940-49dc-8c29-25083c498cc7 => generated 109 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 11:03:48.932112 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-0202bfdf-3e68-467c-8ccf-99fadf41b020 tempest-VolumesSnapshotsTestJSON-1424857693 tempest-VolumesSnapshotsTestJSON-1424857693-project] Calling method '.version_select at 0x7faab29a41f0>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:03:48.978744 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.wsgi [None req-0202bfdf-3e68-467c-8ccf-99fadf41b020 tempest-VolumesSnapshotsTestJSON-1424857693 tempest-VolumesSnapshotsTestJSON-1424857693-project] HTTP exception thrown: Volume 96726e60-b940-49dc-8c29-25083c498cc7 could not be found. Aug 11 11:03:48.980723 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-0202bfdf-3e68-467c-8ccf-99fadf41b020 tempest-VolumesSnapshotsTestJSON-1424857693 tempest-VolumesSnapshotsTestJSON-1424857693-project] Request method failure captured: Aug 11 11:03:48.980723 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: request: DELETE /compute/v2.1/os-volumes/96726e60-b940-49dc-8c29-25083c498cc7 HTTP/1.1 Aug 11 11:03:48.980723 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Accept: application/json Aug 11 11:03:48.980723 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Accept-Encoding: identity Aug 11 11:03:48.980723 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Connection: close Aug 11 11:03:48.980723 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Content-Length: 0 Aug 11 11:03:48.980723 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Content-Type: application/json Aug 11 11:03:48.980723 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Host: 10.222.0.48 Aug 11 11:03:48.980723 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Openstack-System-Scope: None Aug 11 11:03:48.980723 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: User-Agent: python-urllib3/1.26.11 Aug 11 11:03:48.980723 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Auth-Token: gAAAAABi9OIIfTcysMm5yotVwfi3vAh83gRSL3xD9i3_0VtsJMR9clou3gxye2gI7twp6ABoYnJ21VN8SDi8-ubWojKfgg1gjAIXIEwBDVqnDk7V4Qevj5oxJnMuBvk7otP3snn-zAC6Dk1IOi6SLYM8jEper7WAj1FbM7Kk_99pvQ7Y1QofWp0 Aug 11 11:03:48.980723 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Domain-Id: None Aug 11 11:03:48.980723 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Domain-Name: None Aug 11 11:03:48.980723 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Identity-Status: Confirmed Aug 11 11:03:48.980723 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Is-Admin-Project: True Aug 11 11:03:48.980723 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Domain-Id: default Aug 11 11:03:48.980723 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Domain-Name: Default Aug 11 11:03:48.980723 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Id: d11d73b282114c02bed69938677e2e58 Aug 11 11:03:48.980723 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1424857693 Aug 11 11:03:48.980723 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Role: reader,member Aug 11 11:03:48.980723 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Roles: reader,member Aug 11 11:03:48.981998 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d11d73b282114c02bed69938677e2e58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d11d73b282114c02bed69938677e2e58"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d11d73b282114c02bed69938677e2e58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d11d73b282114c02bed69938677e2e58", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] Aug 11 11:03:48.981998 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1424857693 Aug 11 11:03:48.981998 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Tenant-Id: d11d73b282114c02bed69938677e2e58 Aug 11 11:03:48.981998 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1424857693 Aug 11 11:03:48.981998 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User: tempest-VolumesSnapshotsTestJSON-1424857693-project Aug 11 11:03:48.981998 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Domain-Id: default Aug 11 11:03:48.981998 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Domain-Name: Default Aug 11 11:03:48.981998 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Id: b226ddd101ae4ff9aeab0fc797a349f5 Aug 11 11:03:48.981998 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1424857693-project Aug 11 11:03:48.981998 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: method: Aug 11 11:03:48.981998 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: exception: Volume 96726e60-b940-49dc-8c29-25083c498cc7 could not be found. Aug 11 11:03:48.981998 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: action_args: {'id': '96726e60-b940-49dc-8c29-25083c498cc7'} Aug 11 11:03:48.981998 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 11:03:48.982883 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:03:48.982883 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 11 11:03:48.982883 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 11 11:03:48.982883 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 11 11:03:48.982883 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 11 11:03:48.982883 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 11 11:03:48.982883 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 11 11:03:48.982883 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 11 11:03:48.982883 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 11 11:03:48.982883 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 11 11:03:48.982883 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 11 11:03:48.982883 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 11 11:03:48.982883 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 11 11:03:48.982883 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 11 11:03:48.982883 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 11 11:03:48.982883 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 96726e60-b940-49dc-8c29-25083c498cc7 could not be found. (HTTP 404) (Request-ID: req-a9b0ab19-3545-4700-b6ec-2a8fba9a8b71) Aug 11 11:03:48.982883 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:03:48.982883 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:03:48.982883 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:03:48.987077 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:03:48.987077 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 11 11:03:48.987077 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 11 11:03:48.987077 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 11 11:03:48.987077 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 11 11:03:48.987077 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 11 11:03:48.987077 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 11 11:03:48.987077 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 11 11:03:48.987077 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 11 11:03:48.987077 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 11 11:03:48.987077 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 11 11:03:48.987077 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 11 11:03:48.987077 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 11 11:03:48.987077 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 11 11:03:48.987077 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 11 11:03:48.987077 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 11 11:03:48.987077 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 11 11:03:48.987077 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 11 11:03:48.987077 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 11 11:03:48.988512 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 11 11:03:48.988512 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 11 11:03:48.988512 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 11 11:03:48.988512 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 11 11:03:48.988512 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 96726e60-b940-49dc-8c29-25083c498cc7 could not be found. Aug 11 11:03:48.988512 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:03:48.988512 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:03:48.988512 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:03:48.988512 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:03:48.988512 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:03:48.988512 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:03:48.988512 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 11:03:48.988512 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 11:03:48.988512 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 11 11:03:48.988512 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 11 11:03:48.988512 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 11:03:48.988512 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 11:03:48.988512 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 11 11:03:48.988512 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 11:03:48.989725 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 96726e60-b940-49dc-8c29-25083c498cc7 could not be found. Aug 11 11:03:48.989725 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:03:48.989725 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:03:48.989725 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:03:48.989725 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:03:48.989725 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:03:48.989725 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:03:48.989725 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 11:03:48.989725 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 11:03:48.989725 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 96726e60-b940-49dc-8c29-25083c498cc7 could not be found. Aug 11 11:03:48.989725 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:03:48.989725 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-0202bfdf-3e68-467c-8ccf-99fadf41b020 tempest-VolumesSnapshotsTestJSON-1424857693 tempest-VolumesSnapshotsTestJSON-1424857693-project] Returning 404 to user: Volume 96726e60-b940-49dc-8c29-25083c498cc7 could not be found. {{(pid=121232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 11:03:48.989725 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-0202bfdf-3e68-467c-8ccf-99fadf41b020 tempest-VolumesSnapshotsTestJSON-1424857693 tempest-VolumesSnapshotsTestJSON-1424857693-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/96726e60-b940-49dc-8c29-25083c498cc7" status: 404 len: 109 microversion: 2.1 time: 0.054993 Aug 11 11:03:48.989725 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 21/37] 10.222.0.48 () {58 vars in 1248 bytes} [Thu Aug 11 11:03:48 2022] DELETE /compute/v2.1/os-volumes/96726e60-b940-49dc-8c29-25083c498cc7 => generated 109 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 11:03:48.995585 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-535cb9df-ff54-4398-9c11-8da8f2377da7 tempest-VolumesSnapshotsTestJSON-1424857693 tempest-VolumesSnapshotsTestJSON-1424857693-project] Calling method '.version_select at 0x7faab2a73ca0>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:03:49.044548 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.wsgi [None req-535cb9df-ff54-4398-9c11-8da8f2377da7 tempest-VolumesSnapshotsTestJSON-1424857693 tempest-VolumesSnapshotsTestJSON-1424857693-project] HTTP exception thrown: Volume 96726e60-b940-49dc-8c29-25083c498cc7 could not be found. Aug 11 11:03:49.046822 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-535cb9df-ff54-4398-9c11-8da8f2377da7 tempest-VolumesSnapshotsTestJSON-1424857693 tempest-VolumesSnapshotsTestJSON-1424857693-project] Request method failure captured: Aug 11 11:03:49.046822 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: request: GET /compute/v2.1/os-volumes/96726e60-b940-49dc-8c29-25083c498cc7 HTTP/1.1 Aug 11 11:03:49.046822 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Accept: application/json Aug 11 11:03:49.046822 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Accept-Encoding: identity Aug 11 11:03:49.046822 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Connection: close Aug 11 11:03:49.046822 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Content-Length: 0 Aug 11 11:03:49.046822 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Content-Type: application/json Aug 11 11:03:49.046822 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Host: 10.222.0.48 Aug 11 11:03:49.046822 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Openstack-System-Scope: None Aug 11 11:03:49.046822 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: User-Agent: python-urllib3/1.26.11 Aug 11 11:03:49.046822 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Auth-Token: gAAAAABi9OIIfTcysMm5yotVwfi3vAh83gRSL3xD9i3_0VtsJMR9clou3gxye2gI7twp6ABoYnJ21VN8SDi8-ubWojKfgg1gjAIXIEwBDVqnDk7V4Qevj5oxJnMuBvk7otP3snn-zAC6Dk1IOi6SLYM8jEper7WAj1FbM7Kk_99pvQ7Y1QofWp0 Aug 11 11:03:49.046822 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Domain-Id: None Aug 11 11:03:49.046822 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Domain-Name: None Aug 11 11:03:49.046822 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Identity-Status: Confirmed Aug 11 11:03:49.046822 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Is-Admin-Project: True Aug 11 11:03:49.046822 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Domain-Id: default Aug 11 11:03:49.046822 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Domain-Name: Default Aug 11 11:03:49.046822 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Id: d11d73b282114c02bed69938677e2e58 Aug 11 11:03:49.046822 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1424857693 Aug 11 11:03:49.046822 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Role: reader,member Aug 11 11:03:49.046822 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Roles: reader,member Aug 11 11:03:49.048050 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d11d73b282114c02bed69938677e2e58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/d11d73b282114c02bed69938677e2e58"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/d11d73b282114c02bed69938677e2e58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_d11d73b282114c02bed69938677e2e58", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] Aug 11 11:03:49.048050 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1424857693 Aug 11 11:03:49.048050 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant-Id: d11d73b282114c02bed69938677e2e58 Aug 11 11:03:49.048050 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1424857693 Aug 11 11:03:49.048050 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User: tempest-VolumesSnapshotsTestJSON-1424857693-project Aug 11 11:03:49.048050 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Domain-Id: default Aug 11 11:03:49.048050 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Domain-Name: Default Aug 11 11:03:49.048050 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Id: b226ddd101ae4ff9aeab0fc797a349f5 Aug 11 11:03:49.048050 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1424857693-project Aug 11 11:03:49.048050 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: method: Aug 11 11:03:49.048050 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: exception: Volume 96726e60-b940-49dc-8c29-25083c498cc7 could not be found. Aug 11 11:03:49.048050 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: action_args: {'id': '96726e60-b940-49dc-8c29-25083c498cc7'} Aug 11 11:03:49.048050 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 11:03:49.048816 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:03:49.048816 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 11 11:03:49.048816 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 11 11:03:49.048816 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 11 11:03:49.048816 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 11 11:03:49.048816 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 11 11:03:49.048816 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 11 11:03:49.048816 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 11 11:03:49.048816 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 11 11:03:49.048816 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 11 11:03:49.048816 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 11 11:03:49.048816 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 11 11:03:49.048816 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 11 11:03:49.048816 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 11 11:03:49.048816 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 11 11:03:49.048816 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 96726e60-b940-49dc-8c29-25083c498cc7 could not be found. (HTTP 404) (Request-ID: req-399489d2-c4eb-4fcb-b7f4-9443e51a4b51) Aug 11 11:03:49.048816 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:03:49.048816 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:03:49.048816 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:03:49.049851 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:03:49.049851 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 11 11:03:49.049851 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 11 11:03:49.049851 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 11 11:03:49.049851 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 11 11:03:49.049851 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 11 11:03:49.049851 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 11 11:03:49.049851 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 11 11:03:49.049851 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 11 11:03:49.049851 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 11 11:03:49.049851 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 11 11:03:49.049851 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 11 11:03:49.049851 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 11 11:03:49.049851 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 11 11:03:49.049851 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 11 11:03:49.049851 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 11 11:03:49.049851 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 11 11:03:49.049851 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 11 11:03:49.049851 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 11 11:03:49.051160 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 11 11:03:49.051160 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 11 11:03:49.051160 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 11 11:03:49.051160 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 11 11:03:49.051160 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 96726e60-b940-49dc-8c29-25083c498cc7 could not be found. Aug 11 11:03:49.051160 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:03:49.051160 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:03:49.051160 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:03:49.051160 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:03:49.051160 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:03:49.051160 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:03:49.051160 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 11:03:49.051160 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 11:03:49.051160 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 11 11:03:49.051160 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 11 11:03:49.051160 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 11:03:49.051160 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 11:03:49.051160 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 11 11:03:49.051160 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 11:03:49.060148 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 96726e60-b940-49dc-8c29-25083c498cc7 could not be found. Aug 11 11:03:49.060148 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:03:49.060148 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:03:49.060148 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:03:49.060148 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:03:49.060148 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:03:49.060148 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:03:49.060148 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 11:03:49.060148 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 11:03:49.060148 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 96726e60-b940-49dc-8c29-25083c498cc7 could not be found. Aug 11 11:03:49.060148 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:03:49.060148 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-535cb9df-ff54-4398-9c11-8da8f2377da7 tempest-VolumesSnapshotsTestJSON-1424857693 tempest-VolumesSnapshotsTestJSON-1424857693-project] Returning 404 to user: Volume 96726e60-b940-49dc-8c29-25083c498cc7 could not be found. {{(pid=121231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 11:03:49.060148 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-535cb9df-ff54-4398-9c11-8da8f2377da7 tempest-VolumesSnapshotsTestJSON-1424857693 tempest-VolumesSnapshotsTestJSON-1424857693-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/96726e60-b940-49dc-8c29-25083c498cc7" status: 404 len: 109 microversion: 2.1 time: 0.061954 Aug 11 11:03:49.060148 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 17/38] 10.222.0.48 () {58 vars in 1245 bytes} [Thu Aug 11 11:03:48 2022] GET /compute/v2.1/os-volumes/96726e60-b940-49dc-8c29-25083c498cc7 => generated 109 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 11:03:52.824184 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-cca5676a-c779-42ad-91f3-e1d6947fc978 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-486548037", "imageRef": "05993162-aafd-4f1d-b781-ec09593713e5", "flavorRef": "452", "networks": [{"uuid": "5245ae43-61b4-4f42-a9b9-c3a22b081933"}]}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:03:53.137088 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.network.neutron [None req-cca5676a-c779-42ad-91f3-e1d6947fc978 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] validate_networks() for [('5245ae43-61b4-4f42-a9b9-c3a22b081933', None, None, None, None, None)] {{(pid=121232) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 11 11:03:55.106086 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-12ccaa8d-53ba-4353-a1da-4de18245bf17 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Action: 'create', calling method: .version_select at 0x7faab2a73a60>, body: {"keypair": {"name": "tempest-keypair-427342936", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOSX/xSDhrBkFAgjAfAb+U38pTFeJ8wes1de47JGUnB8qiwAqFv+fOqYQ8ISNjrDcmJN+i7mylV1DDA8/vI49gLG5Nd98a9D3DbFUqesq7BNMjQQjWhsDngA9FACoCPZrg=="}} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:03:55.167102 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.quota [None req-12ccaa8d-53ba-4353-a1da-4de18245bf17 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Getting quotas for project c42a3b4ef2d644b58856779226688f88. Resources: {'key_pairs'} {{(pid=121231) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 11:03:55.195176 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.quota [None req-12ccaa8d-53ba-4353-a1da-4de18245bf17 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Getting quotas for user 1b7724f3ef4543ed9c3df0455ae4fb76 and project c42a3b4ef2d644b58856779226688f88. Resources: {'key_pairs'} {{(pid=121231) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 11:03:55.390698 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-12ccaa8d-53ba-4353-a1da-4de18245bf17 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.999200 Aug 11 11:03:55.391635 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 18/39] 10.222.0.48 () {62 vars in 1200 bytes} [Thu Aug 11 11:03:54 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1001 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 11 11:03:55.732925 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-8ceed3aa-502c-49dc-831f-679642e9b8da tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-201868287", "imageRef": "05993162-aafd-4f1d-b781-ec09593713e5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:03:55.845973 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-cca5676a-c779-42ad-91f3-e1d6947fc978 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Flavor limits 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 11 11:03:55.848370 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-cca5676a-c779-42ad-91f3-e1d6947fc978 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Image limits 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 11 11:03:55.849710 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-cca5676a-c779-42ad-91f3-e1d6947fc978 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Flavor pref 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 11 11:03:55.855578 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-cca5676a-c779-42ad-91f3-e1d6947fc978 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Image pref 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 11 11:03:55.856853 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-cca5676a-c779-42ad-91f3-e1d6947fc978 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 11 11:03:55.877133 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cca5676a-c779-42ad-91f3-e1d6947fc978 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:03:55.877133 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cca5676a-c779-42ad-91f3-e1d6947fc978 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:03:55.877133 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cca5676a-c779-42ad-91f3-e1d6947fc978 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:03:55.877133 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cca5676a-c779-42ad-91f3-e1d6947fc978 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:03:55.877822 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cca5676a-c779-42ad-91f3-e1d6947fc978 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:03:55.878733 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cca5676a-c779-42ad-91f3-e1d6947fc978 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:03:55.897678 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.network.neutron [None req-8ceed3aa-502c-49dc-831f-679642e9b8da tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] validate_networks() for [('8fa2e066-f14c-4214-a992-60ab79c83482', None, None, None, None, None)] {{(pid=121231) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 11 11:03:55.976908 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-cca5676a-c779-42ad-91f3-e1d6947fc978 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Getting quotas for project cbb076c769694966bbfea2f23ea8b8a4. Resources: {'ram', 'cores', 'instances'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 11:03:55.984091 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-cca5676a-c779-42ad-91f3-e1d6947fc978 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Getting quotas for user 2d6fc583bb8a4434b0c6538c9ffbde75 and project cbb076c769694966bbfea2f23ea8b8a4. Resources: {'ram', 'cores', 'instances'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 11:03:56.003488 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-cca5676a-c779-42ad-91f3-e1d6947fc978 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Going to run 1 instances... {{(pid=121232) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 11 11:03:56.007234 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-cca5676a-c779-42ad-91f3-e1d6947fc978 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] [instance: 89f57d2f-28f8-4ad2-8b20-e6533726993b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='05993162-aafd-4f1d-b781-ec09593713e5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121232) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 11 11:03:56.281127 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-cca5676a-c779-42ad-91f3-e1d6947fc978 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.267341 Aug 11 11:03:56.295562 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 22/40] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Aug 11 11:03:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 4283 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 11 11:03:56.303114 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-7feb62b1-0c4a-49b6-8d10-2221c44548d0 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1529084174", "imageRef": "05993162-aafd-4f1d-b781-ec09593713e5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4e2afb68-108c-43af-95ea-9643e985c18c"}], "security_groups": [{"name": "tempest-securitygroup--179711734"}], "key_name": "tempest-keypair-839198739", "user_data": "}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:03:56.484601 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.network.neutron [None req-7feb62b1-0c4a-49b6-8d10-2221c44548d0 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] validate_networks() for [('4e2afb68-108c-43af-95ea-9643e985c18c', None, None, None, None, None)] {{(pid=121232) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 11 11:03:57.120366 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-7feb62b1-0c4a-49b6-8d10-2221c44548d0 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Flavor limits 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 11 11:03:57.120366 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-7feb62b1-0c4a-49b6-8d10-2221c44548d0 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Image limits 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 11 11:03:57.120366 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-7feb62b1-0c4a-49b6-8d10-2221c44548d0 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Flavor pref 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 11 11:03:57.121110 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-7feb62b1-0c4a-49b6-8d10-2221c44548d0 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Image pref 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 11 11:03:57.121190 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-7feb62b1-0c4a-49b6-8d10-2221c44548d0 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 11 11:03:57.132491 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7feb62b1-0c4a-49b6-8d10-2221c44548d0 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:03:57.132992 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7feb62b1-0c4a-49b6-8d10-2221c44548d0 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:03:57.133448 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7feb62b1-0c4a-49b6-8d10-2221c44548d0 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:03:57.134155 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7feb62b1-0c4a-49b6-8d10-2221c44548d0 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:03:57.134615 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7feb62b1-0c4a-49b6-8d10-2221c44548d0 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:03:57.135039 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7feb62b1-0c4a-49b6-8d10-2221c44548d0 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:03:57.159878 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-7feb62b1-0c4a-49b6-8d10-2221c44548d0 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Getting quotas for project b0b3799012d24fad98d155e3b000fc22. Resources: {'ram', 'cores', 'instances'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 11:03:57.167444 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-7feb62b1-0c4a-49b6-8d10-2221c44548d0 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Getting quotas for user bb18a00d44ed4af186bdc589e1e14e22 and project b0b3799012d24fad98d155e3b000fc22. Resources: {'ram', 'cores', 'instances'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 11:03:57.192603 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-7feb62b1-0c4a-49b6-8d10-2221c44548d0 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Going to run 1 instances... {{(pid=121232) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 11 11:03:57.194985 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-7feb62b1-0c4a-49b6-8d10-2221c44548d0 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='05993162-aafd-4f1d-b781-ec09593713e5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121232) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 11 11:03:57.335694 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-7feb62b1-0c4a-49b6-8d10-2221c44548d0 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.037498 Aug 11 11:03:57.336835 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 23/41] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Aug 11 11:03:56 2022] POST /compute/v2.1/servers => generated 401 bytes in 1041 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 11 11:03:57.342904 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-5a49cb2d-8e20-4e20-ac66-a44bfd4a4263 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:03:57.344127 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-5a49cb2d-8e20-4e20-ac66-a44bfd4a4263 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] [instance: 89f57d2f-28f8-4ad2-8b20-e6533726993b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:03:57.685290 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-5a49cb2d-8e20-4e20-ac66-a44bfd4a4263 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6fc583bb8a4434b0c6538c9ffbde75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb076c769694966bbfea2f23ea8b8a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:03:57.720786 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-5a49cb2d-8e20-4e20-ac66-a44bfd4a4263 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] 10.222.0.48 "GET /compute/v2.1/servers/89f57d2f-28f8-4ad2-8b20-e6533726993b" status: 200 len: 1214 microversion: 2.1 time: 0.381994 Aug 11 11:03:57.737425 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 24/42] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:03:57 2022] GET /compute/v2.1/servers/89f57d2f-28f8-4ad2-8b20-e6533726993b => generated 1214 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:03:57.750699 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-035fa7ea-dad3-4f50-aa63-9849c798f166 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:03:57.754178 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-035fa7ea-dad3-4f50-aa63-9849c798f166 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:03:58.016712 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-035fa7ea-dad3-4f50-aa63-9849c798f166 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:03:58.026206 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-035fa7ea-dad3-4f50-aa63-9849c798f166 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1237 microversion: 2.1 time: 0.289427 Aug 11 11:03:58.026794 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 25/43] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:03:57 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1237 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:03:58.061625 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-8ceed3aa-502c-49dc-831f-679642e9b8da tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Flavor limits 0:0:0 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 11 11:03:58.062136 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-8ceed3aa-502c-49dc-831f-679642e9b8da tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Image limits 0:0:0 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 11 11:03:58.062516 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-8ceed3aa-502c-49dc-831f-679642e9b8da tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Flavor pref 0:0:0 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 11 11:03:58.062928 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-8ceed3aa-502c-49dc-831f-679642e9b8da tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Image pref 0:0:0 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 11 11:03:58.063356 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-8ceed3aa-502c-49dc-831f-679642e9b8da tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 11 11:03:58.099043 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8ceed3aa-502c-49dc-831f-679642e9b8da tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:03:58.099918 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8ceed3aa-502c-49dc-831f-679642e9b8da tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:03:58.110429 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8ceed3aa-502c-49dc-831f-679642e9b8da tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:03:58.111854 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8ceed3aa-502c-49dc-831f-679642e9b8da tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:03:58.112689 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8ceed3aa-502c-49dc-831f-679642e9b8da tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:03:58.118592 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8ceed3aa-502c-49dc-831f-679642e9b8da tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:03:58.242723 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.quota [None req-8ceed3aa-502c-49dc-831f-679642e9b8da tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Getting quotas for project e8751d4bd74240db9b57b7e9f788df94. Resources: {'ram', 'cores', 'instances'} {{(pid=121231) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 11:03:58.272344 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.quota [None req-8ceed3aa-502c-49dc-831f-679642e9b8da tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Getting quotas for user 684d59041e82466d8aad6d2964842bf5 and project e8751d4bd74240db9b57b7e9f788df94. Resources: {'ram', 'cores', 'instances'} {{(pid=121231) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 11:03:58.337235 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-8ceed3aa-502c-49dc-831f-679642e9b8da tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Going to run 1 instances... {{(pid=121231) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 11 11:03:58.346433 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-8ceed3aa-502c-49dc-831f-679642e9b8da tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 7cfaa606-ef7e-4594-aaba-72be96386bd7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='05993162-aafd-4f1d-b781-ec09593713e5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121231) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 11 11:03:58.694517 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-8ceed3aa-502c-49dc-831f-679642e9b8da tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.301630 Aug 11 11:03:58.695874 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 19/44] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Aug 11 11:03:55 2022] POST /compute/v2.1/servers => generated 383 bytes in 3304 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 11 11:03:58.707391 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-37d0f68d-7ad9-4d67-980f-237b2f83fb62 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:03:58.712230 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-37d0f68d-7ad9-4d67-980f-237b2f83fb62 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 7cfaa606-ef7e-4594-aaba-72be96386bd7] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:03:58.757400 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-3f6e3609-7d7f-48aa-abfe-804f7b8dff3b tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:03:58.758317 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-3f6e3609-7d7f-48aa-abfe-804f7b8dff3b tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] [instance: 89f57d2f-28f8-4ad2-8b20-e6533726993b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:03:58.866722 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-37d0f68d-7ad9-4d67-980f-237b2f83fb62 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:03:58.878879 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-37d0f68d-7ad9-4d67-980f-237b2f83fb62 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/7cfaa606-ef7e-4594-aaba-72be96386bd7" status: 200 len: 1221 microversion: 2.1 time: 0.175117 Aug 11 11:03:58.895987 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 26/45] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:03:58 2022] GET /compute/v2.1/servers/7cfaa606-ef7e-4594-aaba-72be96386bd7 => generated 1221 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:03:59.041165 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-3f6e3609-7d7f-48aa-abfe-804f7b8dff3b tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6fc583bb8a4434b0c6538c9ffbde75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb076c769694966bbfea2f23ea8b8a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:03:59.047965 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-afa32a6e-0fa5-44b0-ab5e-38307f766d9d tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:03:59.048576 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-afa32a6e-0fa5-44b0-ab5e-38307f766d9d tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:03:59.074233 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-3f6e3609-7d7f-48aa-abfe-804f7b8dff3b tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] 10.222.0.48 "GET /compute/v2.1/servers/89f57d2f-28f8-4ad2-8b20-e6533726993b" status: 200 len: 1214 microversion: 2.1 time: 0.320062 Aug 11 11:03:59.076964 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 20/46] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:03:58 2022] GET /compute/v2.1/servers/89f57d2f-28f8-4ad2-8b20-e6533726993b => generated 1214 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:03:59.189710 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-afa32a6e-0fa5-44b0-ab5e-38307f766d9d tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:03:59.197253 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-afa32a6e-0fa5-44b0-ab5e-38307f766d9d tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1237 microversion: 2.1 time: 0.154661 Aug 11 11:03:59.208031 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 27/47] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:03:59 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1237 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:03:59.631417 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-505e58d3-f05c-4ac6-9b31-8b4d69f592fb tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-546772896", "imageRef": "05993162-aafd-4f1d-b781-ec09593713e5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:03:59.739491 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.network.neutron [None req-505e58d3-f05c-4ac6-9b31-8b4d69f592fb tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] validate_networks() for [('8fa2e066-f14c-4214-a992-60ab79c83482', None, None, None, None, None)] {{(pid=121231) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 11 11:04:00.098431 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-ef45ec16-70a1-493b-84cb-57b28c9f2352 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:00.100124 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-ef45ec16-70a1-493b-84cb-57b28c9f2352 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] [instance: 89f57d2f-28f8-4ad2-8b20-e6533726993b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:00.222916 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-ef45ec16-70a1-493b-84cb-57b28c9f2352 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6fc583bb8a4434b0c6538c9ffbde75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb076c769694966bbfea2f23ea8b8a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:00.234868 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-ef45ec16-70a1-493b-84cb-57b28c9f2352 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] 10.222.0.48 "GET /compute/v2.1/servers/89f57d2f-28f8-4ad2-8b20-e6533726993b" status: 200 len: 1214 microversion: 2.1 time: 0.142053 Aug 11 11:04:00.235834 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 28/48] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:00 2022] GET /compute/v2.1/servers/89f57d2f-28f8-4ad2-8b20-e6533726993b => generated 1214 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:04:00.243070 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-ab30ea13-5d94-4c21-8151-c2ebcfd5a5f8 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:00.253022 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-ab30ea13-5d94-4c21-8151-c2ebcfd5a5f8 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:00.261222 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ab30ea13-5d94-4c21-8151-c2ebcfd5a5f8 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:00.261891 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ab30ea13-5d94-4c21-8151-c2ebcfd5a5f8 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:00.262681 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ab30ea13-5d94-4c21-8151-c2ebcfd5a5f8 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:00.263528 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ab30ea13-5d94-4c21-8151-c2ebcfd5a5f8 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:00.264881 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ab30ea13-5d94-4c21-8151-c2ebcfd5a5f8 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:00.264997 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ab30ea13-5d94-4c21-8151-c2ebcfd5a5f8 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:00.502785 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-505e58d3-f05c-4ac6-9b31-8b4d69f592fb tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Flavor limits 0:0:0 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 11 11:04:00.510952 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-505e58d3-f05c-4ac6-9b31-8b4d69f592fb tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Image limits 0:0:0 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 11 11:04:00.510952 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-505e58d3-f05c-4ac6-9b31-8b4d69f592fb tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Flavor pref 0:0:0 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 11 11:04:00.510952 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-505e58d3-f05c-4ac6-9b31-8b4d69f592fb tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Image pref 0:0:0 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 11 11:04:00.510952 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-505e58d3-f05c-4ac6-9b31-8b4d69f592fb tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 11 11:04:00.524318 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-505e58d3-f05c-4ac6-9b31-8b4d69f592fb tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:00.530720 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-505e58d3-f05c-4ac6-9b31-8b4d69f592fb tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:00.531347 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-505e58d3-f05c-4ac6-9b31-8b4d69f592fb tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:00.533810 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-505e58d3-f05c-4ac6-9b31-8b4d69f592fb tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:00.535982 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-505e58d3-f05c-4ac6-9b31-8b4d69f592fb tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:00.538179 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-505e58d3-f05c-4ac6-9b31-8b4d69f592fb tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:00.582457 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.quota [None req-505e58d3-f05c-4ac6-9b31-8b4d69f592fb tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Getting quotas for project e8751d4bd74240db9b57b7e9f788df94. Resources: {'ram', 'cores', 'instances'} {{(pid=121231) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 11:04:00.591608 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.quota [None req-505e58d3-f05c-4ac6-9b31-8b4d69f592fb tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Getting quotas for user 684d59041e82466d8aad6d2964842bf5 and project e8751d4bd74240db9b57b7e9f788df94. Resources: {'ram', 'cores', 'instances'} {{(pid=121231) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 11:04:00.610678 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-ab30ea13-5d94-4c21-8151-c2ebcfd5a5f8 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:00.627587 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-505e58d3-f05c-4ac6-9b31-8b4d69f592fb tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Going to run 1 instances... {{(pid=121231) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 11 11:04:00.629962 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-505e58d3-f05c-4ac6-9b31-8b4d69f592fb tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: a09cb964-88a4-4fad-ae60-efb0a7a7dec2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='05993162-aafd-4f1d-b781-ec09593713e5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121231) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 11 11:04:00.635679 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-ab30ea13-5d94-4c21-8151-c2ebcfd5a5f8 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1241 microversion: 2.1 time: 0.397372 Aug 11 11:04:00.637910 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 29/49] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:00 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1241 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:04:00.658792 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-4efe932a-1d9c-403e-95b6-74ca93f93630 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-584836344", "imageRef": "05993162-aafd-4f1d-b781-ec09593713e5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "52ea2947-a913-4941-bc7f-78d92d3d4a71"}], "security_groups": [{"name": "tempest-securitygroup--32988440"}], "key_name": "tempest-keypair-427342936", "user_data": "}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:04:00.890264 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-505e58d3-f05c-4ac6-9b31-8b4d69f592fb tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.263629 Aug 11 11:04:00.891864 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 21/50] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Aug 11 11:03:59 2022] POST /compute/v2.1/servers => generated 383 bytes in 1266 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 11 11:04:00.933665 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-f56764a9-3cbc-4248-8639-7fb9461af61a tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:00.937656 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-f56764a9-3cbc-4248-8639-7fb9461af61a tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: a09cb964-88a4-4fad-ae60-efb0a7a7dec2] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:00.968170 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.network.neutron [None req-4efe932a-1d9c-403e-95b6-74ca93f93630 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] validate_networks() for [('52ea2947-a913-4941-bc7f-78d92d3d4a71', None, None, None, None, None)] {{(pid=121232) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 11 11:04:01.159492 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-f56764a9-3cbc-4248-8639-7fb9461af61a tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:01.172503 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-f56764a9-3cbc-4248-8639-7fb9461af61a tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2" status: 200 len: 1221 microversion: 2.1 time: 0.246657 Aug 11 11:04:01.176247 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 22/51] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:00 2022] GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2 => generated 1221 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:04:01.277161 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-4636b959-79dd-40e0-a896-3159d07a0556 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:01.277161 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-4636b959-79dd-40e0-a896-3159d07a0556 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] [instance: 89f57d2f-28f8-4ad2-8b20-e6533726993b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:01.298891 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4636b959-79dd-40e0-a896-3159d07a0556 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:01.304526 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4636b959-79dd-40e0-a896-3159d07a0556 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:01.317569 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4636b959-79dd-40e0-a896-3159d07a0556 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:01.336258 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4636b959-79dd-40e0-a896-3159d07a0556 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:01.343429 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4636b959-79dd-40e0-a896-3159d07a0556 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:01.345058 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4636b959-79dd-40e0-a896-3159d07a0556 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:01.833484 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-4636b959-79dd-40e0-a896-3159d07a0556 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6fc583bb8a4434b0c6538c9ffbde75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb076c769694966bbfea2f23ea8b8a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:01.881199 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-4636b959-79dd-40e0-a896-3159d07a0556 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] 10.222.0.48 "GET /compute/v2.1/servers/89f57d2f-28f8-4ad2-8b20-e6533726993b" status: 200 len: 1210 microversion: 2.1 time: 0.620315 Aug 11 11:04:01.885481 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 23/52] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:01 2022] GET /compute/v2.1/servers/89f57d2f-28f8-4ad2-8b20-e6533726993b => generated 1210 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:04:01.914043 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-05622bbf-cfc0-403b-a911-e9ea90265673 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:01.917156 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-05622bbf-cfc0-403b-a911-e9ea90265673 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:01.951916 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-05622bbf-cfc0-403b-a911-e9ea90265673 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:01.953152 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-05622bbf-cfc0-403b-a911-e9ea90265673 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:01.956055 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-05622bbf-cfc0-403b-a911-e9ea90265673 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:01.957008 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-05622bbf-cfc0-403b-a911-e9ea90265673 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:01.958546 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-05622bbf-cfc0-403b-a911-e9ea90265673 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:01.959015 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-05622bbf-cfc0-403b-a911-e9ea90265673 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:02.112110 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-05622bbf-cfc0-403b-a911-e9ea90265673 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:02.123312 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-05622bbf-cfc0-403b-a911-e9ea90265673 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1289 microversion: 2.1 time: 0.235813 Aug 11 11:04:02.137217 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 24/53] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:01 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1289 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:04:02.196768 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-4efe932a-1d9c-403e-95b6-74ca93f93630 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Flavor limits 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 11 11:04:02.197261 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-4efe932a-1d9c-403e-95b6-74ca93f93630 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Image limits 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 11 11:04:02.197842 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-4efe932a-1d9c-403e-95b6-74ca93f93630 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Flavor pref 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 11 11:04:02.198383 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-4efe932a-1d9c-403e-95b6-74ca93f93630 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Image pref 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 11 11:04:02.198907 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-4efe932a-1d9c-403e-95b6-74ca93f93630 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 11 11:04:02.201860 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-a25f2e4d-1e94-4183-a6c2-fc3ae0207877 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:02.203174 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-a25f2e4d-1e94-4183-a6c2-fc3ae0207877 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: a09cb964-88a4-4fad-ae60-efb0a7a7dec2] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:02.212862 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4efe932a-1d9c-403e-95b6-74ca93f93630 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:02.213724 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4efe932a-1d9c-403e-95b6-74ca93f93630 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:02.217035 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4efe932a-1d9c-403e-95b6-74ca93f93630 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:02.217035 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4efe932a-1d9c-403e-95b6-74ca93f93630 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:02.217035 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4efe932a-1d9c-403e-95b6-74ca93f93630 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:02.217035 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4efe932a-1d9c-403e-95b6-74ca93f93630 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:02.247122 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-4efe932a-1d9c-403e-95b6-74ca93f93630 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Getting quotas for project c42a3b4ef2d644b58856779226688f88. Resources: {'ram', 'cores', 'instances'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 11:04:02.251992 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-4efe932a-1d9c-403e-95b6-74ca93f93630 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Getting quotas for user 1b7724f3ef4543ed9c3df0455ae4fb76 and project c42a3b4ef2d644b58856779226688f88. Resources: {'ram', 'cores', 'instances'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 11:04:02.287434 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-4efe932a-1d9c-403e-95b6-74ca93f93630 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Going to run 1 instances... {{(pid=121232) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 11 11:04:02.289623 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-4efe932a-1d9c-403e-95b6-74ca93f93630 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='05993162-aafd-4f1d-b781-ec09593713e5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121232) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 11 11:04:02.325998 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-a25f2e4d-1e94-4183-a6c2-fc3ae0207877 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:02.335010 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-a25f2e4d-1e94-4183-a6c2-fc3ae0207877 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2" status: 200 len: 1221 microversion: 2.1 time: 0.137376 Aug 11 11:04:02.348039 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 25/54] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:02 2022] GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2 => generated 1221 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:04:02.569308 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-4efe932a-1d9c-403e-95b6-74ca93f93630 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 1.924520 Aug 11 11:04:02.583275 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 30/55] 10.222.0.48 () {62 vars in 1188 bytes} [Thu Aug 11 11:04:00 2022] POST /compute/v2.1/servers => generated 400 bytes in 1945 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 11 11:04:02.584592 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-a0d40543-91e8-45af-8812-f0c2d462a01b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:02.589772 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-a0d40543-91e8-45af-8812-f0c2d462a01b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:02.687869 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-a0d40543-91e8-45af-8812-f0c2d462a01b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:02.695675 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-a0d40543-91e8-45af-8812-f0c2d462a01b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:02.697311 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-a0d40543-91e8-45af-8812-f0c2d462a01b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:02.698744 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-a0d40543-91e8-45af-8812-f0c2d462a01b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1280 microversion: 2.20 time: 0.118407 Aug 11 11:04:02.708570 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 26/56] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:04:02 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1280 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 11:04:02.906602 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-dae8fd05-4583-44e6-a4cb-098cee374464 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:02.907223 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-dae8fd05-4583-44e6-a4cb-098cee374464 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] [instance: 89f57d2f-28f8-4ad2-8b20-e6533726993b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:02.913627 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dae8fd05-4583-44e6-a4cb-098cee374464 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:02.914156 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dae8fd05-4583-44e6-a4cb-098cee374464 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:02.914670 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dae8fd05-4583-44e6-a4cb-098cee374464 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:02.915714 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dae8fd05-4583-44e6-a4cb-098cee374464 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:02.920253 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dae8fd05-4583-44e6-a4cb-098cee374464 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:02.920253 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dae8fd05-4583-44e6-a4cb-098cee374464 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:02.991496 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-dae8fd05-4583-44e6-a4cb-098cee374464 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6fc583bb8a4434b0c6538c9ffbde75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb076c769694966bbfea2f23ea8b8a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:03.000020 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-dae8fd05-4583-44e6-a4cb-098cee374464 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] 10.222.0.48 "GET /compute/v2.1/servers/89f57d2f-28f8-4ad2-8b20-e6533726993b" status: 200 len: 1266 microversion: 2.1 time: 0.097285 Aug 11 11:04:03.000820 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 31/57] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:02 2022] GET /compute/v2.1/servers/89f57d2f-28f8-4ad2-8b20-e6533726993b => generated 1266 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:04:03.147532 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-52ba6ea8-0293-4d79-ba55-a2ad27b70213 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:03.148172 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-52ba6ea8-0293-4d79-ba55-a2ad27b70213 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:03.159568 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-52ba6ea8-0293-4d79-ba55-a2ad27b70213 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:03.160820 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-52ba6ea8-0293-4d79-ba55-a2ad27b70213 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:03.162236 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-52ba6ea8-0293-4d79-ba55-a2ad27b70213 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:03.163354 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-52ba6ea8-0293-4d79-ba55-a2ad27b70213 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:03.165855 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-52ba6ea8-0293-4d79-ba55-a2ad27b70213 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:03.166847 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-52ba6ea8-0293-4d79-ba55-a2ad27b70213 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:03.359863 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-308c899c-3ddb-44d6-be8c-1270660b184b tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:03.360822 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-308c899c-3ddb-44d6-be8c-1270660b184b tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: a09cb964-88a4-4fad-ae60-efb0a7a7dec2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:03.381223 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-308c899c-3ddb-44d6-be8c-1270660b184b tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:03.382067 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-308c899c-3ddb-44d6-be8c-1270660b184b tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:03.382720 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-308c899c-3ddb-44d6-be8c-1270660b184b tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:03.388975 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-308c899c-3ddb-44d6-be8c-1270660b184b tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:03.392015 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-308c899c-3ddb-44d6-be8c-1270660b184b tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:03.392852 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-308c899c-3ddb-44d6-be8c-1270660b184b tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:03.696749 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-52ba6ea8-0293-4d79-ba55-a2ad27b70213 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:03.705942 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-52ba6ea8-0293-4d79-ba55-a2ad27b70213 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1307 microversion: 2.1 time: 0.563116 Aug 11 11:04:03.724365 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 27/58] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:03 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1307 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:04:03.733063 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-214881cc-9d98-4f54-9212-0e4578195d45 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:03.734251 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-214881cc-9d98-4f54-9212-0e4578195d45 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:03.817328 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-308c899c-3ddb-44d6-be8c-1270660b184b tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:03.846918 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-308c899c-3ddb-44d6-be8c-1270660b184b tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2" status: 200 len: 1217 microversion: 2.1 time: 0.491420 Aug 11 11:04:03.855814 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 32/59] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:03 2022] GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2 => generated 1217 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:04:04.025729 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-94ebfb4b-9b62-4bef-9cde-1442a3c04e37 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:04.026870 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-94ebfb4b-9b62-4bef-9cde-1442a3c04e37 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] [instance: 89f57d2f-28f8-4ad2-8b20-e6533726993b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:04.042856 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-94ebfb4b-9b62-4bef-9cde-1442a3c04e37 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:04.049321 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-94ebfb4b-9b62-4bef-9cde-1442a3c04e37 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:04.049321 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-94ebfb4b-9b62-4bef-9cde-1442a3c04e37 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:04.049321 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-94ebfb4b-9b62-4bef-9cde-1442a3c04e37 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:04.049722 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-94ebfb4b-9b62-4bef-9cde-1442a3c04e37 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:04.051547 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-94ebfb4b-9b62-4bef-9cde-1442a3c04e37 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:04.240682 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-214881cc-9d98-4f54-9212-0e4578195d45 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:04.255353 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-214881cc-9d98-4f54-9212-0e4578195d45 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:04.256924 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-214881cc-9d98-4f54-9212-0e4578195d45 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:04.258039 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-214881cc-9d98-4f54-9212-0e4578195d45 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1280 microversion: 2.20 time: 0.531739 Aug 11 11:04:04.258595 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 28/60] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:04:03 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1280 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:04:04.335577 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-94ebfb4b-9b62-4bef-9cde-1442a3c04e37 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6fc583bb8a4434b0c6538c9ffbde75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb076c769694966bbfea2f23ea8b8a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:04.358595 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-94ebfb4b-9b62-4bef-9cde-1442a3c04e37 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] 10.222.0.48 "GET /compute/v2.1/servers/89f57d2f-28f8-4ad2-8b20-e6533726993b" status: 200 len: 1284 microversion: 2.1 time: 0.336770 Aug 11 11:04:04.358595 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 33/61] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:04 2022] GET /compute/v2.1/servers/89f57d2f-28f8-4ad2-8b20-e6533726993b => generated 1284 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:04:04.730513 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-98d2f30e-71d0-45b5-a3d3-3e609d1ab4ad tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:04.731886 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-98d2f30e-71d0-45b5-a3d3-3e609d1ab4ad tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:04.745018 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-98d2f30e-71d0-45b5-a3d3-3e609d1ab4ad tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:04.745405 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-98d2f30e-71d0-45b5-a3d3-3e609d1ab4ad tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:04.745851 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-98d2f30e-71d0-45b5-a3d3-3e609d1ab4ad tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:04.747080 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-98d2f30e-71d0-45b5-a3d3-3e609d1ab4ad tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:04.758411 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-98d2f30e-71d0-45b5-a3d3-3e609d1ab4ad tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:04.758932 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-98d2f30e-71d0-45b5-a3d3-3e609d1ab4ad tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:04.882906 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-fda52e9c-6c22-48a4-a5db-539578822a72 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:04.883595 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-fda52e9c-6c22-48a4-a5db-539578822a72 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: a09cb964-88a4-4fad-ae60-efb0a7a7dec2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:04.892851 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fda52e9c-6c22-48a4-a5db-539578822a72 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:04.897475 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fda52e9c-6c22-48a4-a5db-539578822a72 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:04.897827 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fda52e9c-6c22-48a4-a5db-539578822a72 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:04.898776 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fda52e9c-6c22-48a4-a5db-539578822a72 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:04.899250 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fda52e9c-6c22-48a4-a5db-539578822a72 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:04.899876 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fda52e9c-6c22-48a4-a5db-539578822a72 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:05.522456 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-fda52e9c-6c22-48a4-a5db-539578822a72 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:05.544457 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-fda52e9c-6c22-48a4-a5db-539578822a72 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2" status: 200 len: 1281 microversion: 2.1 time: 0.665879 Aug 11 11:04:05.554040 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 34/62] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:04 2022] GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2 => generated 1281 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:04:05.585910 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-b0a16411-1a71-4b58-a9f3-921db0e74b09 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:05.593304 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-b0a16411-1a71-4b58-a9f3-921db0e74b09 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:05.638723 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b0a16411-1a71-4b58-a9f3-921db0e74b09 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:05.640359 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b0a16411-1a71-4b58-a9f3-921db0e74b09 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:05.640934 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b0a16411-1a71-4b58-a9f3-921db0e74b09 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:05.641680 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b0a16411-1a71-4b58-a9f3-921db0e74b09 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:05.642171 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b0a16411-1a71-4b58-a9f3-921db0e74b09 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:05.642604 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b0a16411-1a71-4b58-a9f3-921db0e74b09 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:06.000442 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-98d2f30e-71d0-45b5-a3d3-3e609d1ab4ad tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:06.012429 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-98d2f30e-71d0-45b5-a3d3-3e609d1ab4ad tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1362 microversion: 2.1 time: 1.285028 Aug 11 11:04:06.020095 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 29/63] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:04 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1362 bytes in 1294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:04:06.033471 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-8dccb200-1d98-4e62-a0ce-b67b59cdcf33 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:06.046338 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-8dccb200-1d98-4e62-a0ce-b67b59cdcf33 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] [instance: 89f57d2f-28f8-4ad2-8b20-e6533726993b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:06.080137 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8dccb200-1d98-4e62-a0ce-b67b59cdcf33 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:06.081036 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8dccb200-1d98-4e62-a0ce-b67b59cdcf33 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:06.081700 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8dccb200-1d98-4e62-a0ce-b67b59cdcf33 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:06.082663 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8dccb200-1d98-4e62-a0ce-b67b59cdcf33 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:06.085093 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8dccb200-1d98-4e62-a0ce-b67b59cdcf33 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:06.086084 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8dccb200-1d98-4e62-a0ce-b67b59cdcf33 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:06.657248 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-b0a16411-1a71-4b58-a9f3-921db0e74b09 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:06.683961 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-b0a16411-1a71-4b58-a9f3-921db0e74b09 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:06.690909 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-b0a16411-1a71-4b58-a9f3-921db0e74b09 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:06.705507 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-b0a16411-1a71-4b58-a9f3-921db0e74b09 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1276 microversion: 2.20 time: 1.143635 Aug 11 11:04:06.705507 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 35/64] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:04:05 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1276 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:04:06.719554 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-70a0641e-d98b-4a27-a161-2911d2129b49 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:06.723089 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-70a0641e-d98b-4a27-a161-2911d2129b49 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: a09cb964-88a4-4fad-ae60-efb0a7a7dec2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:06.753431 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-70a0641e-d98b-4a27-a161-2911d2129b49 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:06.753431 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-70a0641e-d98b-4a27-a161-2911d2129b49 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:06.753431 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-70a0641e-d98b-4a27-a161-2911d2129b49 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:06.753431 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-70a0641e-d98b-4a27-a161-2911d2129b49 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:06.753999 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-70a0641e-d98b-4a27-a161-2911d2129b49 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:06.753999 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-70a0641e-d98b-4a27-a161-2911d2129b49 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:06.755176 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-8dccb200-1d98-4e62-a0ce-b67b59cdcf33 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6fc583bb8a4434b0c6538c9ffbde75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb076c769694966bbfea2f23ea8b8a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:06.769510 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-8dccb200-1d98-4e62-a0ce-b67b59cdcf33 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] 10.222.0.48 "GET /compute/v2.1/servers/89f57d2f-28f8-4ad2-8b20-e6533726993b" status: 200 len: 1272 microversion: 2.1 time: 0.747941 Aug 11 11:04:06.772133 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 30/65] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:06 2022] GET /compute/v2.1/servers/89f57d2f-28f8-4ad2-8b20-e6533726993b => generated 1272 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:04:06.914966 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-70a0641e-d98b-4a27-a161-2911d2129b49 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:06.979786 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-70a0641e-d98b-4a27-a161-2911d2129b49 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2" status: 200 len: 1279 microversion: 2.1 time: 0.233355 Aug 11 11:04:06.979786 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 36/66] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:06 2022] GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2 => generated 1279 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:04:07.040476 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-fd1dda35-17e9-4365-bdf0-e0e11c26e6bb tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:07.042208 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-fd1dda35-17e9-4365-bdf0-e0e11c26e6bb tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:07.063469 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fd1dda35-17e9-4365-bdf0-e0e11c26e6bb tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:07.070309 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fd1dda35-17e9-4365-bdf0-e0e11c26e6bb tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:07.204755 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fd1dda35-17e9-4365-bdf0-e0e11c26e6bb tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:07.204755 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fd1dda35-17e9-4365-bdf0-e0e11c26e6bb tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:07.204755 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fd1dda35-17e9-4365-bdf0-e0e11c26e6bb tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:07.204755 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fd1dda35-17e9-4365-bdf0-e0e11c26e6bb tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:07.457553 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-fd1dda35-17e9-4365-bdf0-e0e11c26e6bb tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:07.472899 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-fd1dda35-17e9-4365-bdf0-e0e11c26e6bb tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1362 microversion: 2.1 time: 0.436054 Aug 11 11:04:07.475179 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 31/67] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:07 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1362 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:04:07.729904 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-c1a8be4e-d62b-47cd-a527-a71223a89dc4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:07.731289 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-c1a8be4e-d62b-47cd-a527-a71223a89dc4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:07.735055 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:04:07.756305 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c1a8be4e-d62b-47cd-a527-a71223a89dc4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:07.756305 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c1a8be4e-d62b-47cd-a527-a71223a89dc4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:07.756305 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c1a8be4e-d62b-47cd-a527-a71223a89dc4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:07.756305 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c1a8be4e-d62b-47cd-a527-a71223a89dc4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:07.756859 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c1a8be4e-d62b-47cd-a527-a71223a89dc4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:07.756859 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c1a8be4e-d62b-47cd-a527-a71223a89dc4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:07.794332 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-33b4eb58-5575-42d0-89b5-55394fb526ab tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:07.795886 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-33b4eb58-5575-42d0-89b5-55394fb526ab tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] [instance: 89f57d2f-28f8-4ad2-8b20-e6533726993b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:07.814495 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-33b4eb58-5575-42d0-89b5-55394fb526ab tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:07.819620 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-33b4eb58-5575-42d0-89b5-55394fb526ab tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:07.819620 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-33b4eb58-5575-42d0-89b5-55394fb526ab tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:07.819620 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-33b4eb58-5575-42d0-89b5-55394fb526ab tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:07.819620 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-33b4eb58-5575-42d0-89b5-55394fb526ab tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:07.820139 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-33b4eb58-5575-42d0-89b5-55394fb526ab tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:08.129385 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-c1a8be4e-d62b-47cd-a527-a71223a89dc4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:08.143608 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-c1a8be4e-d62b-47cd-a527-a71223a89dc4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:08.149099 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-c1a8be4e-d62b-47cd-a527-a71223a89dc4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:08.152543 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-c1a8be4e-d62b-47cd-a527-a71223a89dc4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1350 microversion: 2.20 time: 0.433908 Aug 11 11:04:08.162277 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 37/68] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:04:07 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1350 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:04:08.162277 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-5dbcc523-5398-4604-9fda-602ec19af3cc tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:08.162277 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-5dbcc523-5398-4604-9fda-602ec19af3cc tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: a09cb964-88a4-4fad-ae60-efb0a7a7dec2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:08.171961 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5dbcc523-5398-4604-9fda-602ec19af3cc tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:08.173194 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5dbcc523-5398-4604-9fda-602ec19af3cc tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:08.174079 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5dbcc523-5398-4604-9fda-602ec19af3cc tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:08.175414 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5dbcc523-5398-4604-9fda-602ec19af3cc tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:08.176744 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5dbcc523-5398-4604-9fda-602ec19af3cc tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:08.177833 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5dbcc523-5398-4604-9fda-602ec19af3cc tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:09.453727 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-33b4eb58-5575-42d0-89b5-55394fb526ab tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6fc583bb8a4434b0c6538c9ffbde75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb076c769694966bbfea2f23ea8b8a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:09.479962 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-33b4eb58-5575-42d0-89b5-55394fb526ab tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] 10.222.0.48 "GET /compute/v2.1/servers/89f57d2f-28f8-4ad2-8b20-e6533726993b" status: 200 len: 1314 microversion: 2.1 time: 1.684094 Aug 11 11:04:09.505186 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 32/69] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:07 2022] GET /compute/v2.1/servers/89f57d2f-28f8-4ad2-8b20-e6533726993b => generated 1314 bytes in 1716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:04:09.518589 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-ddc9166c-07a9-451a-bd62-d699ed02e89b tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:09.529556 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-ddc9166c-07a9-451a-bd62-d699ed02e89b tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:09.557808 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ddc9166c-07a9-451a-bd62-d699ed02e89b tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:09.559287 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ddc9166c-07a9-451a-bd62-d699ed02e89b tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:09.560699 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ddc9166c-07a9-451a-bd62-d699ed02e89b tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:09.561824 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ddc9166c-07a9-451a-bd62-d699ed02e89b tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:09.568816 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ddc9166c-07a9-451a-bd62-d699ed02e89b tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:09.569669 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ddc9166c-07a9-451a-bd62-d699ed02e89b tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:09.668671 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-5dbcc523-5398-4604-9fda-602ec19af3cc tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:09.706631 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-5dbcc523-5398-4604-9fda-602ec19af3cc tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2" status: 200 len: 1321 microversion: 2.1 time: 1.551162 Aug 11 11:04:09.715644 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 38/70] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:08 2022] GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2 => generated 1321 bytes in 1561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:04:09.734140 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-45eeff47-b407-4315-b259-00099225512e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:09.735256 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-45eeff47-b407-4315-b259-00099225512e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:09.763142 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-45eeff47-b407-4315-b259-00099225512e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:09.763142 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-45eeff47-b407-4315-b259-00099225512e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:09.763142 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-45eeff47-b407-4315-b259-00099225512e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:09.763142 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-45eeff47-b407-4315-b259-00099225512e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:09.763735 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-45eeff47-b407-4315-b259-00099225512e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:09.763735 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-45eeff47-b407-4315-b259-00099225512e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:10.106674 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-45eeff47-b407-4315-b259-00099225512e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:10.119084 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-45eeff47-b407-4315-b259-00099225512e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:10.127684 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-45eeff47-b407-4315-b259-00099225512e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:10.131941 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-45eeff47-b407-4315-b259-00099225512e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1338 microversion: 2.20 time: 0.414947 Aug 11 11:04:10.141997 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 39/71] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:04:09 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1338 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:04:10.557646 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-f8d4e57a-5643-4908-bf4d-1293897143ee req-b5f066a3-6a49-434c-8d28-9d1657703e4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1797716b-0533-42be-8c06-750959aaf935", "tag": "6848a700-8424-47d3-8492-918f43aa51ad"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:04:10.559051 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell0:SELECT=4 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:04:10.590738 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-f8d4e57a-5643-4908-bf4d-1293897143ee req-b5f066a3-6a49-434c-8d28-9d1657703e4b service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:10.592497 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-f8d4e57a-5643-4908-bf4d-1293897143ee req-b5f066a3-6a49-434c-8d28-9d1657703e4b service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:10.593143 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-f8d4e57a-5643-4908-bf4d-1293897143ee req-b5f066a3-6a49-434c-8d28-9d1657703e4b service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:10.637565 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-ddc9166c-07a9-451a-bd62-d699ed02e89b tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:10.649314 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-ddc9166c-07a9-451a-bd62-d699ed02e89b tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1362 microversion: 2.1 time: 1.141760 Aug 11 11:04:10.652614 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 33/72] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:09 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1362 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:04:10.672847 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-f8d4e57a-5643-4908-bf4d-1293897143ee req-b5f066a3-6a49-434c-8d28-9d1657703e4b service nova] Creating event network-changed:6848a700-8424-47d3-8492-918f43aa51ad for instance 1797716b-0533-42be-8c06-750959aaf935 on hv-cinder-82002 Aug 11 11:04:10.673602 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-f8d4e57a-5643-4908-bf4d-1293897143ee req-b5f066a3-6a49-434c-8d28-9d1657703e4b service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121232) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 11 11:04:10.677219 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-f8d4e57a-5643-4908-bf4d-1293897143ee req-b5f066a3-6a49-434c-8d28-9d1657703e4b service nova] Acquired lock "compute-rpcapi-router" {{(pid=121232) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 11 11:04:10.678858 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1fa7dea8-9d64-4ed8-8218-ff92db9e7f4e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:10.680414 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-5f952369-f4e0-42f7-8b29-35b00865ab27 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:10.682114 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1fa7dea8-9d64-4ed8-8218-ff92db9e7f4e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:10.685175 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-5f952369-f4e0-42f7-8b29-35b00865ab27 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] [instance: 89f57d2f-28f8-4ad2-8b20-e6533726993b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:10.687064 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1fa7dea8-9d64-4ed8-8218-ff92db9e7f4e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:10.688494 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1fa7dea8-9d64-4ed8-8218-ff92db9e7f4e None None] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:10.691003 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1fa7dea8-9d64-4ed8-8218-ff92db9e7f4e None None] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:10.691549 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1fa7dea8-9d64-4ed8-8218-ff92db9e7f4e None None] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:10.708801 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5f952369-f4e0-42f7-8b29-35b00865ab27 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:10.711911 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5f952369-f4e0-42f7-8b29-35b00865ab27 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:10.712705 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5f952369-f4e0-42f7-8b29-35b00865ab27 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:10.717062 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5f952369-f4e0-42f7-8b29-35b00865ab27 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:10.717853 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5f952369-f4e0-42f7-8b29-35b00865ab27 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:10.718771 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5f952369-f4e0-42f7-8b29-35b00865ab27 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:10.744276 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.compute.rpcapi [None req-1fa7dea8-9d64-4ed8-8218-ff92db9e7f4e None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 11 11:04:10.747293 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1fa7dea8-9d64-4ed8-8218-ff92db9e7f4e None None] Releasing lock "compute-rpcapi-router" {{(pid=121232) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 11 11:04:10.833772 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-1fa7dea8-9d64-4ed8-8218-ff92db9e7f4e None None] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.573721 Aug 11 11:04:10.834960 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 40/73] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:04:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:04:10.851528 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-89ee4c36-4de6-4645-a012-515ca4c1f47b tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:10.854569 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-89ee4c36-4de6-4645-a012-515ca4c1f47b tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: a09cb964-88a4-4fad-ae60-efb0a7a7dec2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:10.882334 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-89ee4c36-4de6-4645-a012-515ca4c1f47b tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:10.882334 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-89ee4c36-4de6-4645-a012-515ca4c1f47b tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:10.882334 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-89ee4c36-4de6-4645-a012-515ca4c1f47b tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:10.882334 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-89ee4c36-4de6-4645-a012-515ca4c1f47b tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:10.883180 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-89ee4c36-4de6-4645-a012-515ca4c1f47b tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:10.883180 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-89ee4c36-4de6-4645-a012-515ca4c1f47b tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:11.177449 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-5f952369-f4e0-42f7-8b29-35b00865ab27 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6fc583bb8a4434b0c6538c9ffbde75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb076c769694966bbfea2f23ea8b8a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:11.188397 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-5f952369-f4e0-42f7-8b29-35b00865ab27 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] 10.222.0.48 "GET /compute/v2.1/servers/89f57d2f-28f8-4ad2-8b20-e6533726993b" status: 200 len: 1314 microversion: 2.1 time: 0.536523 Aug 11 11:04:11.191452 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 34/74] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:10 2022] GET /compute/v2.1/servers/89f57d2f-28f8-4ad2-8b20-e6533726993b => generated 1314 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:04:11.201568 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-932b187c-3f8a-4850-9e4e-ad7c0fe4121c tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:11.202333 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-932b187c-3f8a-4850-9e4e-ad7c0fe4121c tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:11.237511 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-932b187c-3f8a-4850-9e4e-ad7c0fe4121c tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:11.237511 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-932b187c-3f8a-4850-9e4e-ad7c0fe4121c tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:11.246875 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-932b187c-3f8a-4850-9e4e-ad7c0fe4121c tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:11.248863 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-932b187c-3f8a-4850-9e4e-ad7c0fe4121c tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:11.248863 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-932b187c-3f8a-4850-9e4e-ad7c0fe4121c tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:11.248863 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-932b187c-3f8a-4850-9e4e-ad7c0fe4121c tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:11.272940 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-89ee4c36-4de6-4645-a012-515ca4c1f47b tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:11.281399 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-89ee4c36-4de6-4645-a012-515ca4c1f47b tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2" status: 200 len: 1321 microversion: 2.1 time: 0.444517 Aug 11 11:04:11.288573 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 41/75] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:10 2022] GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2 => generated 1321 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:04:11.366064 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-932b187c-3f8a-4850-9e4e-ad7c0fe4121c tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:11.386760 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-932b187c-3f8a-4850-9e4e-ad7c0fe4121c tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:11.386760 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-932b187c-3f8a-4850-9e4e-ad7c0fe4121c tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:11.387518 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-932b187c-3f8a-4850-9e4e-ad7c0fe4121c tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1338 microversion: 2.20 time: 0.194625 Aug 11 11:04:11.388628 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 35/76] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:04:11 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1338 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:04:11.672640 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-132be63f-fd4f-4ab0-9b71-703c1e5daecc tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:11.673375 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-132be63f-fd4f-4ab0-9b71-703c1e5daecc tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:11.683623 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-132be63f-fd4f-4ab0-9b71-703c1e5daecc tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:11.690924 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-132be63f-fd4f-4ab0-9b71-703c1e5daecc tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:11.691535 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-132be63f-fd4f-4ab0-9b71-703c1e5daecc tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:11.692859 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-132be63f-fd4f-4ab0-9b71-703c1e5daecc tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:11.697390 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-132be63f-fd4f-4ab0-9b71-703c1e5daecc tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:11.700054 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-132be63f-fd4f-4ab0-9b71-703c1e5daecc tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:12.211276 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-45c5ba33-eade-46ff-9df7-5ba37890b474 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:12.212723 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-45c5ba33-eade-46ff-9df7-5ba37890b474 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] [instance: 89f57d2f-28f8-4ad2-8b20-e6533726993b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:12.226751 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-45c5ba33-eade-46ff-9df7-5ba37890b474 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:12.227514 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-45c5ba33-eade-46ff-9df7-5ba37890b474 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:12.228207 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-45c5ba33-eade-46ff-9df7-5ba37890b474 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:12.233078 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-45c5ba33-eade-46ff-9df7-5ba37890b474 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:12.233801 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-45c5ba33-eade-46ff-9df7-5ba37890b474 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:12.234409 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-45c5ba33-eade-46ff-9df7-5ba37890b474 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:12.265818 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell0:SELECT=32 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:04:12.747410 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-132be63f-fd4f-4ab0-9b71-703c1e5daecc tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:12.756154 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-132be63f-fd4f-4ab0-9b71-703c1e5daecc tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1362 microversion: 2.1 time: 1.089425 Aug 11 11:04:12.760124 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 42/77] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:11 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1362 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:04:12.772193 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-dc1c5d71-9804-45a5-84bd-1ce1439af300 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:12.777874 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-dc1c5d71-9804-45a5-84bd-1ce1439af300 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: a09cb964-88a4-4fad-ae60-efb0a7a7dec2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:12.791338 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dc1c5d71-9804-45a5-84bd-1ce1439af300 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:12.792163 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dc1c5d71-9804-45a5-84bd-1ce1439af300 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:12.793321 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dc1c5d71-9804-45a5-84bd-1ce1439af300 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:12.796476 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dc1c5d71-9804-45a5-84bd-1ce1439af300 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:12.797091 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dc1c5d71-9804-45a5-84bd-1ce1439af300 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:12.797698 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dc1c5d71-9804-45a5-84bd-1ce1439af300 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:13.326595 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-45c5ba33-eade-46ff-9df7-5ba37890b474 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6fc583bb8a4434b0c6538c9ffbde75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb076c769694966bbfea2f23ea8b8a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:13.334736 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-45c5ba33-eade-46ff-9df7-5ba37890b474 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] 10.222.0.48 "GET /compute/v2.1/servers/89f57d2f-28f8-4ad2-8b20-e6533726993b" status: 200 len: 1314 microversion: 2.1 time: 1.128206 Aug 11 11:04:13.335333 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 36/78] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:12 2022] GET /compute/v2.1/servers/89f57d2f-28f8-4ad2-8b20-e6533726993b => generated 1314 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:04:13.352989 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-9bd331ce-b18f-4e17-9d84-2b053556df81 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:13.353602 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-9bd331ce-b18f-4e17-9d84-2b053556df81 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:13.364916 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9bd331ce-b18f-4e17-9d84-2b053556df81 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:13.365420 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9bd331ce-b18f-4e17-9d84-2b053556df81 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:13.365858 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9bd331ce-b18f-4e17-9d84-2b053556df81 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:13.368256 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9bd331ce-b18f-4e17-9d84-2b053556df81 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:13.368961 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9bd331ce-b18f-4e17-9d84-2b053556df81 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:13.370038 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9bd331ce-b18f-4e17-9d84-2b053556df81 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:13.402342 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-dc1c5d71-9804-45a5-84bd-1ce1439af300 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:13.419613 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-dc1c5d71-9804-45a5-84bd-1ce1439af300 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2" status: 200 len: 1321 microversion: 2.1 time: 0.657502 Aug 11 11:04:13.422429 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 43/79] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:12 2022] GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2 => generated 1321 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:04:13.696099 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-2d202cf3-b8ec-40dd-92ae-5e8038f995c0 req-65eae161-9725-42bf-b42e-2f626bf1613d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89f57d2f-28f8-4ad2-8b20-e6533726993b", "tag": "88fbb9e2-cef3-480b-b104-e4319e0404cb"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:04:13.729409 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-2d202cf3-b8ec-40dd-92ae-5e8038f995c0 req-65eae161-9725-42bf-b42e-2f626bf1613d service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:13.729409 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-2d202cf3-b8ec-40dd-92ae-5e8038f995c0 req-65eae161-9725-42bf-b42e-2f626bf1613d service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:13.729409 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-2d202cf3-b8ec-40dd-92ae-5e8038f995c0 req-65eae161-9725-42bf-b42e-2f626bf1613d service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:13.757305 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-2d202cf3-b8ec-40dd-92ae-5e8038f995c0 req-65eae161-9725-42bf-b42e-2f626bf1613d service nova] Creating event network-changed:88fbb9e2-cef3-480b-b104-e4319e0404cb for instance 89f57d2f-28f8-4ad2-8b20-e6533726993b on hv-cinder-82002 Aug 11 11:04:13.764305 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-2d202cf3-b8ec-40dd-92ae-5e8038f995c0 req-65eae161-9725-42bf-b42e-2f626bf1613d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.341749 Aug 11 11:04:13.765236 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 44/80] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:04:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:04:13.770439 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-a3717e5f-1d1f-469b-8ff2-4bcc8901f0c8 req-e03aef74-7032-4797-99c2-fd74be774cda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a09cb964-88a4-4fad-ae60-efb0a7a7dec2", "tag": "1fe4417c-0d11-448d-803e-4fef1c525582"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:04:13.799311 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-a3717e5f-1d1f-469b-8ff2-4bcc8901f0c8 req-e03aef74-7032-4797-99c2-fd74be774cda service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:13.799883 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-a3717e5f-1d1f-469b-8ff2-4bcc8901f0c8 req-e03aef74-7032-4797-99c2-fd74be774cda service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:13.800600 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-a3717e5f-1d1f-469b-8ff2-4bcc8901f0c8 req-e03aef74-7032-4797-99c2-fd74be774cda service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:13.836590 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-a3717e5f-1d1f-469b-8ff2-4bcc8901f0c8 req-e03aef74-7032-4797-99c2-fd74be774cda service nova] Creating event network-changed:1fe4417c-0d11-448d-803e-4fef1c525582 for instance a09cb964-88a4-4fad-ae60-efb0a7a7dec2 on hv-cinder-82002 Aug 11 11:04:13.857252 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-a3717e5f-1d1f-469b-8ff2-4bcc8901f0c8 req-e03aef74-7032-4797-99c2-fd74be774cda service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090423 Aug 11 11:04:13.859025 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 45/81] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:04:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:04:13.875885 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-d78b170c-3b4c-4b88-bd71-64c19334ab1b tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:13.881227 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-d78b170c-3b4c-4b88-bd71-64c19334ab1b tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:13.896425 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d78b170c-3b4c-4b88-bd71-64c19334ab1b tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:13.899816 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d78b170c-3b4c-4b88-bd71-64c19334ab1b tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:13.900642 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d78b170c-3b4c-4b88-bd71-64c19334ab1b tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:13.904147 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d78b170c-3b4c-4b88-bd71-64c19334ab1b tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:13.906358 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d78b170c-3b4c-4b88-bd71-64c19334ab1b tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:13.909584 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d78b170c-3b4c-4b88-bd71-64c19334ab1b tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:14.101378 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-9bd331ce-b18f-4e17-9d84-2b053556df81 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:14.111875 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-9bd331ce-b18f-4e17-9d84-2b053556df81 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:14.113820 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-9bd331ce-b18f-4e17-9d84-2b053556df81 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:14.115236 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-9bd331ce-b18f-4e17-9d84-2b053556df81 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1404 microversion: 2.20 time: 0.766052 Aug 11 11:04:14.116502 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 37/82] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:04:13 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1404 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:04:14.360836 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-2275e6e3-dea4-4924-b81b-414c5b90e673 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:14.363503 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-2275e6e3-dea4-4924-b81b-414c5b90e673 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] [instance: 89f57d2f-28f8-4ad2-8b20-e6533726993b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:14.368547 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell0:SELECT=26 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:04:14.387070 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2275e6e3-dea4-4924-b81b-414c5b90e673 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:14.387689 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2275e6e3-dea4-4924-b81b-414c5b90e673 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:14.388856 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2275e6e3-dea4-4924-b81b-414c5b90e673 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:14.389840 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2275e6e3-dea4-4924-b81b-414c5b90e673 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:14.392138 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2275e6e3-dea4-4924-b81b-414c5b90e673 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:14.393471 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2275e6e3-dea4-4924-b81b-414c5b90e673 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:14.560557 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d78b170c-3b4c-4b88-bd71-64c19334ab1b tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:14.595175 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-d78b170c-3b4c-4b88-bd71-64c19334ab1b tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1362 microversion: 2.1 time: 0.727456 Aug 11 11:04:14.595175 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 46/83] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:13 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1362 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:04:14.598079 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-a406de1b-1f03-4c52-b611-122067145470 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:14.598901 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-a406de1b-1f03-4c52-b611-122067145470 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: a09cb964-88a4-4fad-ae60-efb0a7a7dec2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:14.606152 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a406de1b-1f03-4c52-b611-122067145470 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:14.606929 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a406de1b-1f03-4c52-b611-122067145470 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:14.607691 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a406de1b-1f03-4c52-b611-122067145470 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:14.609188 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a406de1b-1f03-4c52-b611-122067145470 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:14.619922 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a406de1b-1f03-4c52-b611-122067145470 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:14.629599 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a406de1b-1f03-4c52-b611-122067145470 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:14.629599 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=100 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:04:14.981106 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-2275e6e3-dea4-4924-b81b-414c5b90e673 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6fc583bb8a4434b0c6538c9ffbde75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb076c769694966bbfea2f23ea8b8a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:14.998499 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-2275e6e3-dea4-4924-b81b-414c5b90e673 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] 10.222.0.48 "GET /compute/v2.1/servers/89f57d2f-28f8-4ad2-8b20-e6533726993b" status: 200 len: 1314 microversion: 2.1 time: 0.643707 Aug 11 11:04:15.013123 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 38/84] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:14 2022] GET /compute/v2.1/servers/89f57d2f-28f8-4ad2-8b20-e6533726993b => generated 1314 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:04:15.140876 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-a406de1b-1f03-4c52-b611-122067145470 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:15.143699 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-fd0225bf-b678-4e3c-98a5-88b6fd381ff2 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:15.144343 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-fd0225bf-b678-4e3c-98a5-88b6fd381ff2 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:15.155514 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-a406de1b-1f03-4c52-b611-122067145470 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2" status: 200 len: 1321 microversion: 2.1 time: 0.563414 Aug 11 11:04:15.168933 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 47/85] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:14 2022] GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2 => generated 1321 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:04:15.171141 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fd0225bf-b678-4e3c-98a5-88b6fd381ff2 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:15.171839 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fd0225bf-b678-4e3c-98a5-88b6fd381ff2 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:15.176297 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fd0225bf-b678-4e3c-98a5-88b6fd381ff2 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:15.177188 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fd0225bf-b678-4e3c-98a5-88b6fd381ff2 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:15.177707 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fd0225bf-b678-4e3c-98a5-88b6fd381ff2 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:15.182392 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fd0225bf-b678-4e3c-98a5-88b6fd381ff2 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:15.614825 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-2bb894c4-9a55-42d5-b6ce-0f5ca36c644f tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:15.615436 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-2bb894c4-9a55-42d5-b6ce-0f5ca36c644f tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:15.627864 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2bb894c4-9a55-42d5-b6ce-0f5ca36c644f tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:15.628400 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2bb894c4-9a55-42d5-b6ce-0f5ca36c644f tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:15.629065 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2bb894c4-9a55-42d5-b6ce-0f5ca36c644f tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:15.629981 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2bb894c4-9a55-42d5-b6ce-0f5ca36c644f tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:15.630584 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2bb894c4-9a55-42d5-b6ce-0f5ca36c644f tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:15.631276 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2bb894c4-9a55-42d5-b6ce-0f5ca36c644f tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:15.960626 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-fd0225bf-b678-4e3c-98a5-88b6fd381ff2 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:15.987790 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-fd0225bf-b678-4e3c-98a5-88b6fd381ff2 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:16.003196 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-fd0225bf-b678-4e3c-98a5-88b6fd381ff2 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:16.005455 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-fd0225bf-b678-4e3c-98a5-88b6fd381ff2 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1404 microversion: 2.20 time: 0.869597 Aug 11 11:04:16.006068 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 39/86] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:04:15 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1404 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:04:16.010810 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-537ebba8-b231-448e-925f-d328d68eeaf1 req-c2cd952b-8837-486b-be38-e512eee5503c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82a61cf6-1f3f-4ced-9806-a06252b9b2cc", "tag": "71bca2c4-19df-4dc2-ad61-c7058687c043"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:04:16.058690 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-537ebba8-b231-448e-925f-d328d68eeaf1 req-c2cd952b-8837-486b-be38-e512eee5503c service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:16.060126 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-537ebba8-b231-448e-925f-d328d68eeaf1 req-c2cd952b-8837-486b-be38-e512eee5503c service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:16.060927 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-537ebba8-b231-448e-925f-d328d68eeaf1 req-c2cd952b-8837-486b-be38-e512eee5503c service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:16.092399 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-537ebba8-b231-448e-925f-d328d68eeaf1 req-c2cd952b-8837-486b-be38-e512eee5503c service nova] Creating event network-changed:71bca2c4-19df-4dc2-ad61-c7058687c043 for instance 82a61cf6-1f3f-4ced-9806-a06252b9b2cc on hv-cinder-82002 Aug 11 11:04:16.097934 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-537ebba8-b231-448e-925f-d328d68eeaf1 req-c2cd952b-8837-486b-be38-e512eee5503c service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121231) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 11 11:04:16.097934 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-537ebba8-b231-448e-925f-d328d68eeaf1 req-c2cd952b-8837-486b-be38-e512eee5503c service nova] Acquired lock "compute-rpcapi-router" {{(pid=121231) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 11 11:04:16.097934 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c16e35af-0639-465a-badf-ea08601e021c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:16.097934 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c16e35af-0639-465a-badf-ea08601e021c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:16.097934 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c16e35af-0639-465a-badf-ea08601e021c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:16.098470 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c16e35af-0639-465a-badf-ea08601e021c None None] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:16.098470 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c16e35af-0639-465a-badf-ea08601e021c None None] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:16.098470 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c16e35af-0639-465a-badf-ea08601e021c None None] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:16.108022 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.compute.rpcapi [None req-c16e35af-0639-465a-badf-ea08601e021c None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 11 11:04:16.109140 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c16e35af-0639-465a-badf-ea08601e021c None None] Releasing lock "compute-rpcapi-router" {{(pid=121231) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 11 11:04:16.125417 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-c16e35af-0639-465a-badf-ea08601e021c None None] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117635 Aug 11 11:04:16.126702 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 40/87] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:04:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:04:16.132369 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-a2b18400-396f-4444-b802-e0273292a0db req-6bac3deb-2ca8-4a37-b691-62260cd1c25d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7cfaa606-ef7e-4594-aaba-72be96386bd7", "tag": "62264662-0d46-4c8b-8645-6e11bfc09892"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:04:16.143133 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-a2b18400-396f-4444-b802-e0273292a0db req-6bac3deb-2ca8-4a37-b691-62260cd1c25d service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:16.143897 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-a2b18400-396f-4444-b802-e0273292a0db req-6bac3deb-2ca8-4a37-b691-62260cd1c25d service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:16.144464 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-a2b18400-396f-4444-b802-e0273292a0db req-6bac3deb-2ca8-4a37-b691-62260cd1c25d service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:16.179159 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-a2b18400-396f-4444-b802-e0273292a0db req-6bac3deb-2ca8-4a37-b691-62260cd1c25d service nova] Creating event network-changed:62264662-0d46-4c8b-8645-6e11bfc09892 for instance 7cfaa606-ef7e-4594-aaba-72be96386bd7 on hv-cinder-82002 Aug 11 11:04:16.188372 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-a2b18400-396f-4444-b802-e0273292a0db req-6bac3deb-2ca8-4a37-b691-62260cd1c25d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059220 Aug 11 11:04:16.192370 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-2bb894c4-9a55-42d5-b6ce-0f5ca36c644f tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:16.193286 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 41/88] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:04:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:04:16.203285 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-2f1de86c-172d-4812-a2c9-0e43fd69b8b7 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:16.204331 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-2f1de86c-172d-4812-a2c9-0e43fd69b8b7 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] [instance: 89f57d2f-28f8-4ad2-8b20-e6533726993b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:16.206105 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-2bb894c4-9a55-42d5-b6ce-0f5ca36c644f tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1362 microversion: 2.1 time: 0.595364 Aug 11 11:04:16.209637 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 48/89] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:15 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1362 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:04:16.211947 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2f1de86c-172d-4812-a2c9-0e43fd69b8b7 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:16.211947 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2f1de86c-172d-4812-a2c9-0e43fd69b8b7 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:16.212378 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2f1de86c-172d-4812-a2c9-0e43fd69b8b7 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:16.213562 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2f1de86c-172d-4812-a2c9-0e43fd69b8b7 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:16.214271 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2f1de86c-172d-4812-a2c9-0e43fd69b8b7 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:16.214834 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2f1de86c-172d-4812-a2c9-0e43fd69b8b7 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:16.219043 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-8439b557-8ea0-43d2-94a7-85dfb7b3d817 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:16.220019 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-8439b557-8ea0-43d2-94a7-85dfb7b3d817 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: a09cb964-88a4-4fad-ae60-efb0a7a7dec2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:16.234338 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8439b557-8ea0-43d2-94a7-85dfb7b3d817 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:16.240256 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8439b557-8ea0-43d2-94a7-85dfb7b3d817 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:16.243888 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8439b557-8ea0-43d2-94a7-85dfb7b3d817 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:16.246102 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8439b557-8ea0-43d2-94a7-85dfb7b3d817 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:16.252140 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8439b557-8ea0-43d2-94a7-85dfb7b3d817 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:16.252864 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8439b557-8ea0-43d2-94a7-85dfb7b3d817 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:17.152915 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-8439b557-8ea0-43d2-94a7-85dfb7b3d817 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:17.161799 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-8439b557-8ea0-43d2-94a7-85dfb7b3d817 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2" status: 200 len: 1321 microversion: 2.1 time: 0.950954 Aug 11 11:04:17.162435 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 49/90] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:16 2022] GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2 => generated 1321 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:04:17.174636 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-cebc7119-6433-49ca-8744-16bdf85f281a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:17.178806 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-cebc7119-6433-49ca-8744-16bdf85f281a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:17.185688 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cebc7119-6433-49ca-8744-16bdf85f281a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:17.186311 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cebc7119-6433-49ca-8744-16bdf85f281a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:17.186923 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cebc7119-6433-49ca-8744-16bdf85f281a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:17.187842 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cebc7119-6433-49ca-8744-16bdf85f281a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:17.188868 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cebc7119-6433-49ca-8744-16bdf85f281a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:17.189507 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cebc7119-6433-49ca-8744-16bdf85f281a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:17.386393 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-2f1de86c-172d-4812-a2c9-0e43fd69b8b7 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6fc583bb8a4434b0c6538c9ffbde75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb076c769694966bbfea2f23ea8b8a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:17.396492 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell1:SELECT=100 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:04:17.403294 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-2f1de86c-172d-4812-a2c9-0e43fd69b8b7 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] 10.222.0.48 "GET /compute/v2.1/servers/89f57d2f-28f8-4ad2-8b20-e6533726993b" status: 200 len: 1314 microversion: 2.1 time: 1.207872 Aug 11 11:04:17.406420 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 42/91] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:16 2022] GET /compute/v2.1/servers/89f57d2f-28f8-4ad2-8b20-e6533726993b => generated 1314 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:04:17.418746 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-265e2bed-c5d5-49ac-a635-698ee9879d64 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:17.422246 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-265e2bed-c5d5-49ac-a635-698ee9879d64 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:17.437777 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:04:17.455051 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-265e2bed-c5d5-49ac-a635-698ee9879d64 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:17.455537 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-265e2bed-c5d5-49ac-a635-698ee9879d64 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:17.455999 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-265e2bed-c5d5-49ac-a635-698ee9879d64 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:17.462719 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-265e2bed-c5d5-49ac-a635-698ee9879d64 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:17.466964 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-265e2bed-c5d5-49ac-a635-698ee9879d64 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:17.468066 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-265e2bed-c5d5-49ac-a635-698ee9879d64 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:17.795007 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-cebc7119-6433-49ca-8744-16bdf85f281a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:17.808444 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-cebc7119-6433-49ca-8744-16bdf85f281a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:17.811163 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-cebc7119-6433-49ca-8744-16bdf85f281a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:17.818594 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-cebc7119-6433-49ca-8744-16bdf85f281a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1404 microversion: 2.20 time: 0.655014 Aug 11 11:04:17.822030 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 50/92] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:04:17 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1404 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:04:17.921626 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-265e2bed-c5d5-49ac-a635-698ee9879d64 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:17.929456 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-265e2bed-c5d5-49ac-a635-698ee9879d64 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1362 microversion: 2.1 time: 0.521096 Aug 11 11:04:17.929955 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 43/93] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:17 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1362 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:04:18.187280 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-bd0ae032-c0fc-4986-a1ba-dfd0c2223fba tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:18.188070 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-bd0ae032-c0fc-4986-a1ba-dfd0c2223fba tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: a09cb964-88a4-4fad-ae60-efb0a7a7dec2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:18.194668 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bd0ae032-c0fc-4986-a1ba-dfd0c2223fba tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:18.195150 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bd0ae032-c0fc-4986-a1ba-dfd0c2223fba tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:18.195579 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bd0ae032-c0fc-4986-a1ba-dfd0c2223fba tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:18.196421 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bd0ae032-c0fc-4986-a1ba-dfd0c2223fba tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:18.196872 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bd0ae032-c0fc-4986-a1ba-dfd0c2223fba tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:18.197371 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bd0ae032-c0fc-4986-a1ba-dfd0c2223fba tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:18.403845 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-bd0ae032-c0fc-4986-a1ba-dfd0c2223fba tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:18.411625 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-bd0ae032-c0fc-4986-a1ba-dfd0c2223fba tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2" status: 200 len: 1321 microversion: 2.1 time: 0.230353 Aug 11 11:04:18.412273 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 51/94] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:18 2022] GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2 => generated 1321 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:04:18.431202 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-b09413a1-5d0c-4852-b34c-14c0a7c30677 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:18.432189 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-b09413a1-5d0c-4852-b34c-14c0a7c30677 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] [instance: 89f57d2f-28f8-4ad2-8b20-e6533726993b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:18.440474 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b09413a1-5d0c-4852-b34c-14c0a7c30677 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:18.440953 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b09413a1-5d0c-4852-b34c-14c0a7c30677 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:18.441515 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b09413a1-5d0c-4852-b34c-14c0a7c30677 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:18.442397 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b09413a1-5d0c-4852-b34c-14c0a7c30677 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:18.442878 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b09413a1-5d0c-4852-b34c-14c0a7c30677 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:18.443346 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b09413a1-5d0c-4852-b34c-14c0a7c30677 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:18.614435 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-b09413a1-5d0c-4852-b34c-14c0a7c30677 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6fc583bb8a4434b0c6538c9ffbde75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb076c769694966bbfea2f23ea8b8a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:18.621898 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-b09413a1-5d0c-4852-b34c-14c0a7c30677 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] 10.222.0.48 "GET /compute/v2.1/servers/89f57d2f-28f8-4ad2-8b20-e6533726993b" status: 200 len: 1314 microversion: 2.1 time: 0.195108 Aug 11 11:04:18.622575 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 44/95] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:18 2022] GET /compute/v2.1/servers/89f57d2f-28f8-4ad2-8b20-e6533726993b => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:04:18.844620 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-6dbe6fe3-bafc-46ff-a043-caa749a4ef04 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:18.845227 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-6dbe6fe3-bafc-46ff-a043-caa749a4ef04 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:18.851514 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6dbe6fe3-bafc-46ff-a043-caa749a4ef04 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:18.852068 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6dbe6fe3-bafc-46ff-a043-caa749a4ef04 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:18.852506 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6dbe6fe3-bafc-46ff-a043-caa749a4ef04 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:18.853187 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6dbe6fe3-bafc-46ff-a043-caa749a4ef04 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:18.853682 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6dbe6fe3-bafc-46ff-a043-caa749a4ef04 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:18.854150 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6dbe6fe3-bafc-46ff-a043-caa749a4ef04 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:18.954581 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-0698fc8e-5315-4abc-b177-4c7ebeca052c tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:18.955343 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-0698fc8e-5315-4abc-b177-4c7ebeca052c tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:18.961472 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0698fc8e-5315-4abc-b177-4c7ebeca052c tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:18.961968 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0698fc8e-5315-4abc-b177-4c7ebeca052c tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:18.962405 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0698fc8e-5315-4abc-b177-4c7ebeca052c tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:18.963100 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0698fc8e-5315-4abc-b177-4c7ebeca052c tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:18.964103 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0698fc8e-5315-4abc-b177-4c7ebeca052c tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:18.964544 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0698fc8e-5315-4abc-b177-4c7ebeca052c tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:19.016364 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-6dbe6fe3-bafc-46ff-a043-caa749a4ef04 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:19.031057 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-6dbe6fe3-bafc-46ff-a043-caa749a4ef04 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:19.032749 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-6dbe6fe3-bafc-46ff-a043-caa749a4ef04 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:19.034055 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-6dbe6fe3-bafc-46ff-a043-caa749a4ef04 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1404 microversion: 2.20 time: 0.193288 Aug 11 11:04:19.034914 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 52/96] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:04:18 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1404 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 11:04:19.112207 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-0698fc8e-5315-4abc-b177-4c7ebeca052c tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:19.123371 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-0698fc8e-5315-4abc-b177-4c7ebeca052c tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1362 microversion: 2.1 time: 0.173123 Aug 11 11:04:19.136311 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 45/97] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:18 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1362 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:04:19.432663 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-92c67d51-68b0-495e-bbcd-9de16a3408e4 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:19.433558 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-92c67d51-68b0-495e-bbcd-9de16a3408e4 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: a09cb964-88a4-4fad-ae60-efb0a7a7dec2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:19.441227 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-92c67d51-68b0-495e-bbcd-9de16a3408e4 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:19.441810 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-92c67d51-68b0-495e-bbcd-9de16a3408e4 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:19.442676 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-92c67d51-68b0-495e-bbcd-9de16a3408e4 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:19.443810 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-92c67d51-68b0-495e-bbcd-9de16a3408e4 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:19.444537 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-92c67d51-68b0-495e-bbcd-9de16a3408e4 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:19.444956 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-92c67d51-68b0-495e-bbcd-9de16a3408e4 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:19.591344 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-92c67d51-68b0-495e-bbcd-9de16a3408e4 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:19.602377 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-92c67d51-68b0-495e-bbcd-9de16a3408e4 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2" status: 200 len: 1321 microversion: 2.1 time: 0.173715 Aug 11 11:04:19.606651 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 53/98] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:19 2022] GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2 => generated 1321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:04:19.642804 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-66a845f3-d1ab-44d0-bf3f-eeb5304d290a tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:19.643561 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-66a845f3-d1ab-44d0-bf3f-eeb5304d290a tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] [instance: 89f57d2f-28f8-4ad2-8b20-e6533726993b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:19.650062 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-66a845f3-d1ab-44d0-bf3f-eeb5304d290a tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:19.650552 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-66a845f3-d1ab-44d0-bf3f-eeb5304d290a tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:19.651514 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-66a845f3-d1ab-44d0-bf3f-eeb5304d290a tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:19.652468 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-66a845f3-d1ab-44d0-bf3f-eeb5304d290a tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:19.652924 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-66a845f3-d1ab-44d0-bf3f-eeb5304d290a tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:19.653350 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-66a845f3-d1ab-44d0-bf3f-eeb5304d290a tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:19.789371 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-66a845f3-d1ab-44d0-bf3f-eeb5304d290a tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6fc583bb8a4434b0c6538c9ffbde75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb076c769694966bbfea2f23ea8b8a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:19.798007 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-66a845f3-d1ab-44d0-bf3f-eeb5304d290a tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] 10.222.0.48 "GET /compute/v2.1/servers/89f57d2f-28f8-4ad2-8b20-e6533726993b" status: 200 len: 1314 microversion: 2.1 time: 0.159013 Aug 11 11:04:19.798610 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 46/99] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:19 2022] GET /compute/v2.1/servers/89f57d2f-28f8-4ad2-8b20-e6533726993b => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:04:20.056314 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-9fa1a140-38e9-4b8d-ba32-491e1a2dc242 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:20.056823 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-9fa1a140-38e9-4b8d-ba32-491e1a2dc242 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:20.063165 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9fa1a140-38e9-4b8d-ba32-491e1a2dc242 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:20.063641 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9fa1a140-38e9-4b8d-ba32-491e1a2dc242 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:20.064100 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9fa1a140-38e9-4b8d-ba32-491e1a2dc242 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:20.064781 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9fa1a140-38e9-4b8d-ba32-491e1a2dc242 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:20.065233 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9fa1a140-38e9-4b8d-ba32-491e1a2dc242 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:20.065653 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9fa1a140-38e9-4b8d-ba32-491e1a2dc242 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:20.145830 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-35086318-f16f-4bd8-8cb1-4138ff34ce41 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:20.146399 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-35086318-f16f-4bd8-8cb1-4138ff34ce41 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:20.153458 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-35086318-f16f-4bd8-8cb1-4138ff34ce41 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:20.153989 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-35086318-f16f-4bd8-8cb1-4138ff34ce41 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:20.154475 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-35086318-f16f-4bd8-8cb1-4138ff34ce41 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:20.155170 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-35086318-f16f-4bd8-8cb1-4138ff34ce41 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:20.155629 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-35086318-f16f-4bd8-8cb1-4138ff34ce41 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:20.156134 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-35086318-f16f-4bd8-8cb1-4138ff34ce41 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:20.212128 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-9fa1a140-38e9-4b8d-ba32-491e1a2dc242 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:20.226619 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-9fa1a140-38e9-4b8d-ba32-491e1a2dc242 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:20.228470 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-9fa1a140-38e9-4b8d-ba32-491e1a2dc242 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:20.229855 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-9fa1a140-38e9-4b8d-ba32-491e1a2dc242 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1404 microversion: 2.20 time: 0.177446 Aug 11 11:04:20.230947 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 54/100] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:04:20 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1404 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:04:20.324608 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-35086318-f16f-4bd8-8cb1-4138ff34ce41 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:20.333980 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-35086318-f16f-4bd8-8cb1-4138ff34ce41 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1362 microversion: 2.1 time: 0.192053 Aug 11 11:04:20.343888 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 47/101] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:20 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1362 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:04:20.625166 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-015a62f1-e859-464c-8953-3c7bd4a2ce68 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:20.625795 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-015a62f1-e859-464c-8953-3c7bd4a2ce68 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: a09cb964-88a4-4fad-ae60-efb0a7a7dec2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:20.631923 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-015a62f1-e859-464c-8953-3c7bd4a2ce68 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:20.632406 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-015a62f1-e859-464c-8953-3c7bd4a2ce68 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:20.632834 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-015a62f1-e859-464c-8953-3c7bd4a2ce68 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:20.633513 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-015a62f1-e859-464c-8953-3c7bd4a2ce68 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:20.633961 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-015a62f1-e859-464c-8953-3c7bd4a2ce68 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:20.634382 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-015a62f1-e859-464c-8953-3c7bd4a2ce68 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:20.720908 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell0:SELECT=8 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:04:20.805218 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-015a62f1-e859-464c-8953-3c7bd4a2ce68 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:20.814139 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-015a62f1-e859-464c-8953-3c7bd4a2ce68 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2" status: 200 len: 1321 microversion: 2.1 time: 0.192730 Aug 11 11:04:20.814777 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 55/102] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:20 2022] GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2 => generated 1321 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:04:20.822077 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-03c24624-b2fb-4c66-96d7-d98d4677906e tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:20.822077 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-03c24624-b2fb-4c66-96d7-d98d4677906e tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] [instance: 89f57d2f-28f8-4ad2-8b20-e6533726993b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:20.826601 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-03c24624-b2fb-4c66-96d7-d98d4677906e tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:20.827309 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-03c24624-b2fb-4c66-96d7-d98d4677906e tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:20.827953 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-03c24624-b2fb-4c66-96d7-d98d4677906e tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:20.828783 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-03c24624-b2fb-4c66-96d7-d98d4677906e tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:20.829533 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-03c24624-b2fb-4c66-96d7-d98d4677906e tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:20.830071 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-03c24624-b2fb-4c66-96d7-d98d4677906e tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:20.989168 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-03c24624-b2fb-4c66-96d7-d98d4677906e tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6fc583bb8a4434b0c6538c9ffbde75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb076c769694966bbfea2f23ea8b8a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:21.000457 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-03c24624-b2fb-4c66-96d7-d98d4677906e tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] 10.222.0.48 "GET /compute/v2.1/servers/89f57d2f-28f8-4ad2-8b20-e6533726993b" status: 200 len: 1314 microversion: 2.1 time: 0.185276 Aug 11 11:04:21.001838 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 48/103] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:20 2022] GET /compute/v2.1/servers/89f57d2f-28f8-4ad2-8b20-e6533726993b => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:04:21.252226 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-6d1a489f-a23f-4c11-b1a7-4424a2bdf470 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:21.252943 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-6d1a489f-a23f-4c11-b1a7-4424a2bdf470 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:21.259087 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6d1a489f-a23f-4c11-b1a7-4424a2bdf470 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:21.259868 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6d1a489f-a23f-4c11-b1a7-4424a2bdf470 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:21.260948 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6d1a489f-a23f-4c11-b1a7-4424a2bdf470 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:21.261721 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6d1a489f-a23f-4c11-b1a7-4424a2bdf470 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:21.262343 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6d1a489f-a23f-4c11-b1a7-4424a2bdf470 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:21.262882 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6d1a489f-a23f-4c11-b1a7-4424a2bdf470 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:21.354997 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-fb71b7c2-f451-4bad-a10a-2ecb5b28e0f7 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:21.355742 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-fb71b7c2-f451-4bad-a10a-2ecb5b28e0f7 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:21.362928 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fb71b7c2-f451-4bad-a10a-2ecb5b28e0f7 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:21.365998 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fb71b7c2-f451-4bad-a10a-2ecb5b28e0f7 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:21.366458 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fb71b7c2-f451-4bad-a10a-2ecb5b28e0f7 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:21.367180 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fb71b7c2-f451-4bad-a10a-2ecb5b28e0f7 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:21.367635 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fb71b7c2-f451-4bad-a10a-2ecb5b28e0f7 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:21.374009 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fb71b7c2-f451-4bad-a10a-2ecb5b28e0f7 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:21.408658 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-6d1a489f-a23f-4c11-b1a7-4424a2bdf470 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:21.417855 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-6d1a489f-a23f-4c11-b1a7-4424a2bdf470 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:21.420023 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-6d1a489f-a23f-4c11-b1a7-4424a2bdf470 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:21.425654 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-6d1a489f-a23f-4c11-b1a7-4424a2bdf470 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1404 microversion: 2.20 time: 0.173117 Aug 11 11:04:21.425654 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 56/104] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:04:21 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1404 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:04:21.532223 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-fb71b7c2-f451-4bad-a10a-2ecb5b28e0f7 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:21.534296 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-fb71b7c2-f451-4bad-a10a-2ecb5b28e0f7 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1362 microversion: 2.1 time: 0.183448 Aug 11 11:04:21.534879 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 49/105] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:21 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1362 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:04:21.834798 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-629c07d5-e8d6-451f-8387-82a54a66f565 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:21.835493 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-629c07d5-e8d6-451f-8387-82a54a66f565 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: a09cb964-88a4-4fad-ae60-efb0a7a7dec2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:21.841688 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-629c07d5-e8d6-451f-8387-82a54a66f565 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:21.842367 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-629c07d5-e8d6-451f-8387-82a54a66f565 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:21.842800 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-629c07d5-e8d6-451f-8387-82a54a66f565 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:21.843670 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-629c07d5-e8d6-451f-8387-82a54a66f565 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:21.844173 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-629c07d5-e8d6-451f-8387-82a54a66f565 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:21.844598 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-629c07d5-e8d6-451f-8387-82a54a66f565 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:21.983542 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-629c07d5-e8d6-451f-8387-82a54a66f565 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:21.996046 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-629c07d5-e8d6-451f-8387-82a54a66f565 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2" status: 200 len: 1321 microversion: 2.1 time: 0.165210 Aug 11 11:04:21.996993 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 57/106] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:21 2022] GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2 => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:04:22.022185 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-0550e818-0e1a-4ca1-9f2d-dc677b081019 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:22.022796 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-0550e818-0e1a-4ca1-9f2d-dc677b081019 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] [instance: 89f57d2f-28f8-4ad2-8b20-e6533726993b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:22.028994 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0550e818-0e1a-4ca1-9f2d-dc677b081019 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:22.029695 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0550e818-0e1a-4ca1-9f2d-dc677b081019 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:22.030327 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0550e818-0e1a-4ca1-9f2d-dc677b081019 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:22.031231 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0550e818-0e1a-4ca1-9f2d-dc677b081019 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:22.031901 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0550e818-0e1a-4ca1-9f2d-dc677b081019 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:22.032505 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0550e818-0e1a-4ca1-9f2d-dc677b081019 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:22.172425 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-0550e818-0e1a-4ca1-9f2d-dc677b081019 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6fc583bb8a4434b0c6538c9ffbde75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb076c769694966bbfea2f23ea8b8a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:22.179834 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-0550e818-0e1a-4ca1-9f2d-dc677b081019 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] 10.222.0.48 "GET /compute/v2.1/servers/89f57d2f-28f8-4ad2-8b20-e6533726993b" status: 200 len: 1314 microversion: 2.1 time: 0.161623 Aug 11 11:04:22.180419 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 50/107] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:22 2022] GET /compute/v2.1/servers/89f57d2f-28f8-4ad2-8b20-e6533726993b => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:04:22.444426 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-cbfb2738-161c-4e80-a9b7-8c5bd7feb224 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:22.445215 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-cbfb2738-161c-4e80-a9b7-8c5bd7feb224 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:22.451392 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cbfb2738-161c-4e80-a9b7-8c5bd7feb224 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:22.451934 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cbfb2738-161c-4e80-a9b7-8c5bd7feb224 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:22.452396 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cbfb2738-161c-4e80-a9b7-8c5bd7feb224 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:22.453062 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cbfb2738-161c-4e80-a9b7-8c5bd7feb224 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:22.453522 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cbfb2738-161c-4e80-a9b7-8c5bd7feb224 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:22.453977 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cbfb2738-161c-4e80-a9b7-8c5bd7feb224 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:22.564553 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-03b75cc4-493e-454e-b119-8b2de9ecbea9 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:22.565385 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-03b75cc4-493e-454e-b119-8b2de9ecbea9 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:22.576650 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-03b75cc4-493e-454e-b119-8b2de9ecbea9 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:22.581674 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-03b75cc4-493e-454e-b119-8b2de9ecbea9 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:22.582117 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-03b75cc4-493e-454e-b119-8b2de9ecbea9 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:22.582988 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-03b75cc4-493e-454e-b119-8b2de9ecbea9 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:22.583599 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-03b75cc4-493e-454e-b119-8b2de9ecbea9 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:22.584051 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-03b75cc4-493e-454e-b119-8b2de9ecbea9 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:22.629662 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-cbfb2738-161c-4e80-a9b7-8c5bd7feb224 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:22.635435 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-cbfb2738-161c-4e80-a9b7-8c5bd7feb224 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:22.637840 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-cbfb2738-161c-4e80-a9b7-8c5bd7feb224 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:22.639226 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-cbfb2738-161c-4e80-a9b7-8c5bd7feb224 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1404 microversion: 2.20 time: 0.198768 Aug 11 11:04:22.640311 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 58/108] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:04:22 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1404 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 11:04:22.741059 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-03b75cc4-493e-454e-b119-8b2de9ecbea9 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:22.749836 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-03b75cc4-493e-454e-b119-8b2de9ecbea9 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1362 microversion: 2.1 time: 0.198173 Aug 11 11:04:22.751814 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 51/109] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:22 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1362 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:04:23.020268 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-4ae8ce31-056c-4187-81fd-bef64d26afb2 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:23.020796 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-4ae8ce31-056c-4187-81fd-bef64d26afb2 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: a09cb964-88a4-4fad-ae60-efb0a7a7dec2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:23.029213 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4ae8ce31-056c-4187-81fd-bef64d26afb2 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:23.029213 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4ae8ce31-056c-4187-81fd-bef64d26afb2 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:23.029213 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4ae8ce31-056c-4187-81fd-bef64d26afb2 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:23.029589 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4ae8ce31-056c-4187-81fd-bef64d26afb2 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:23.029747 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4ae8ce31-056c-4187-81fd-bef64d26afb2 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:23.030172 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4ae8ce31-056c-4187-81fd-bef64d26afb2 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:23.167191 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-4ae8ce31-056c-4187-81fd-bef64d26afb2 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:23.175858 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-4ae8ce31-056c-4187-81fd-bef64d26afb2 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2" status: 200 len: 1321 microversion: 2.1 time: 0.159414 Aug 11 11:04:23.176494 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 59/110] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:23 2022] GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2 => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:04:23.205851 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-bdb47d0a-a851-45bd-bdeb-f08237e643f2 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:23.205851 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-bdb47d0a-a851-45bd-bdeb-f08237e643f2 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] [instance: 89f57d2f-28f8-4ad2-8b20-e6533726993b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:23.210502 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-bdb47d0a-a851-45bd-bdeb-f08237e643f2 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:23.211242 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-bdb47d0a-a851-45bd-bdeb-f08237e643f2 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:23.211983 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-bdb47d0a-a851-45bd-bdeb-f08237e643f2 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:23.212759 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-bdb47d0a-a851-45bd-bdeb-f08237e643f2 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:23.213614 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-bdb47d0a-a851-45bd-bdeb-f08237e643f2 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:23.214040 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-bdb47d0a-a851-45bd-bdeb-f08237e643f2 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:23.349389 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-bdb47d0a-a851-45bd-bdeb-f08237e643f2 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6fc583bb8a4434b0c6538c9ffbde75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb076c769694966bbfea2f23ea8b8a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:23.360520 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-bdb47d0a-a851-45bd-bdeb-f08237e643f2 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] 10.222.0.48 "GET /compute/v2.1/servers/89f57d2f-28f8-4ad2-8b20-e6533726993b" status: 200 len: 1314 microversion: 2.1 time: 0.163062 Aug 11 11:04:23.361120 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 52/111] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:23 2022] GET /compute/v2.1/servers/89f57d2f-28f8-4ad2-8b20-e6533726993b => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:04:23.662208 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-adcdd091-c354-4048-bf17-179a8161ed0f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:23.662851 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-adcdd091-c354-4048-bf17-179a8161ed0f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:23.669379 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-adcdd091-c354-4048-bf17-179a8161ed0f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:23.669885 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-adcdd091-c354-4048-bf17-179a8161ed0f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:23.670304 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-adcdd091-c354-4048-bf17-179a8161ed0f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:23.670990 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-adcdd091-c354-4048-bf17-179a8161ed0f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:23.671444 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-adcdd091-c354-4048-bf17-179a8161ed0f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:23.671902 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-adcdd091-c354-4048-bf17-179a8161ed0f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:23.770414 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-d005c7ad-961c-4544-bd10-cd8d6d32cfab tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:23.771040 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-d005c7ad-961c-4544-bd10-cd8d6d32cfab tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:23.777368 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d005c7ad-961c-4544-bd10-cd8d6d32cfab tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:23.777856 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d005c7ad-961c-4544-bd10-cd8d6d32cfab tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:23.778290 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d005c7ad-961c-4544-bd10-cd8d6d32cfab tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:23.778979 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d005c7ad-961c-4544-bd10-cd8d6d32cfab tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:23.779425 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d005c7ad-961c-4544-bd10-cd8d6d32cfab tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:23.779872 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d005c7ad-961c-4544-bd10-cd8d6d32cfab tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:23.818288 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-adcdd091-c354-4048-bf17-179a8161ed0f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:23.828598 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-adcdd091-c354-4048-bf17-179a8161ed0f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:23.830329 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-adcdd091-c354-4048-bf17-179a8161ed0f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:23.831569 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-adcdd091-c354-4048-bf17-179a8161ed0f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1404 microversion: 2.20 time: 0.173213 Aug 11 11:04:23.832221 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 60/112] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:04:23 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1404 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:04:23.940493 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-d005c7ad-961c-4544-bd10-cd8d6d32cfab tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:23.948570 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-d005c7ad-961c-4544-bd10-cd8d6d32cfab tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1362 microversion: 2.1 time: 0.181948 Aug 11 11:04:23.949530 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 53/113] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:23 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1362 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:04:24.205820 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-ed479d24-94c6-4b77-a51f-9d905333efe6 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:24.206515 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-ed479d24-94c6-4b77-a51f-9d905333efe6 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: a09cb964-88a4-4fad-ae60-efb0a7a7dec2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:24.213735 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ed479d24-94c6-4b77-a51f-9d905333efe6 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:24.214213 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ed479d24-94c6-4b77-a51f-9d905333efe6 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:24.214649 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ed479d24-94c6-4b77-a51f-9d905333efe6 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:24.215342 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ed479d24-94c6-4b77-a51f-9d905333efe6 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:24.215823 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ed479d24-94c6-4b77-a51f-9d905333efe6 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:24.216323 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ed479d24-94c6-4b77-a51f-9d905333efe6 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:24.358143 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-ed479d24-94c6-4b77-a51f-9d905333efe6 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:24.367228 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-ed479d24-94c6-4b77-a51f-9d905333efe6 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2" status: 200 len: 1321 microversion: 2.1 time: 0.165775 Aug 11 11:04:24.369093 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 61/114] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:24 2022] GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2 => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:04:24.382756 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-65ae8e9f-27f5-455f-a8c9-79f8eef2c057 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:24.383364 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-65ae8e9f-27f5-455f-a8c9-79f8eef2c057 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] [instance: 89f57d2f-28f8-4ad2-8b20-e6533726993b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:24.389974 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-65ae8e9f-27f5-455f-a8c9-79f8eef2c057 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:24.390444 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-65ae8e9f-27f5-455f-a8c9-79f8eef2c057 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:24.390978 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-65ae8e9f-27f5-455f-a8c9-79f8eef2c057 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:24.391676 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-65ae8e9f-27f5-455f-a8c9-79f8eef2c057 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:24.392190 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-65ae8e9f-27f5-455f-a8c9-79f8eef2c057 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:24.398540 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-65ae8e9f-27f5-455f-a8c9-79f8eef2c057 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:24.537431 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-65ae8e9f-27f5-455f-a8c9-79f8eef2c057 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6fc583bb8a4434b0c6538c9ffbde75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb076c769694966bbfea2f23ea8b8a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:24.545379 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-65ae8e9f-27f5-455f-a8c9-79f8eef2c057 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] 10.222.0.48 "GET /compute/v2.1/servers/89f57d2f-28f8-4ad2-8b20-e6533726993b" status: 200 len: 1314 microversion: 2.1 time: 0.166616 Aug 11 11:04:24.545935 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 54/115] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:24 2022] GET /compute/v2.1/servers/89f57d2f-28f8-4ad2-8b20-e6533726993b => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:04:24.863121 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-600ec915-64f3-478c-8780-b3b042f5345f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:24.863121 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-600ec915-64f3-478c-8780-b3b042f5345f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:24.866061 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-600ec915-64f3-478c-8780-b3b042f5345f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:24.866545 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-600ec915-64f3-478c-8780-b3b042f5345f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:24.866975 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-600ec915-64f3-478c-8780-b3b042f5345f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:24.867661 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-600ec915-64f3-478c-8780-b3b042f5345f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:24.868143 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-600ec915-64f3-478c-8780-b3b042f5345f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:24.868565 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-600ec915-64f3-478c-8780-b3b042f5345f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:24.969648 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-833f5fd3-b2fe-4ed8-bcf6-6e07987f2e18 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:24.970370 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-833f5fd3-b2fe-4ed8-bcf6-6e07987f2e18 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:24.976285 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-833f5fd3-b2fe-4ed8-bcf6-6e07987f2e18 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:24.976772 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-833f5fd3-b2fe-4ed8-bcf6-6e07987f2e18 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:24.977213 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-833f5fd3-b2fe-4ed8-bcf6-6e07987f2e18 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:24.977901 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-833f5fd3-b2fe-4ed8-bcf6-6e07987f2e18 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:24.978357 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-833f5fd3-b2fe-4ed8-bcf6-6e07987f2e18 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:24.979345 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-833f5fd3-b2fe-4ed8-bcf6-6e07987f2e18 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:24.998830 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-600ec915-64f3-478c-8780-b3b042f5345f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:25.007967 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-600ec915-64f3-478c-8780-b3b042f5345f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:25.009858 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-600ec915-64f3-478c-8780-b3b042f5345f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:25.011252 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-600ec915-64f3-478c-8780-b3b042f5345f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1404 microversion: 2.20 time: 0.155990 Aug 11 11:04:25.011981 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 62/116] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:04:24 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1404 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:04:25.122599 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-833f5fd3-b2fe-4ed8-bcf6-6e07987f2e18 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:25.129998 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-833f5fd3-b2fe-4ed8-bcf6-6e07987f2e18 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1362 microversion: 2.1 time: 0.164133 Aug 11 11:04:25.130748 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 55/117] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:24 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:04:25.395791 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-a7a199ed-96d2-4c14-bc71-75fa83310fd2 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:25.396423 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-a7a199ed-96d2-4c14-bc71-75fa83310fd2 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: a09cb964-88a4-4fad-ae60-efb0a7a7dec2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:25.402663 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a7a199ed-96d2-4c14-bc71-75fa83310fd2 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:25.403151 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a7a199ed-96d2-4c14-bc71-75fa83310fd2 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:25.403581 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a7a199ed-96d2-4c14-bc71-75fa83310fd2 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:25.408521 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a7a199ed-96d2-4c14-bc71-75fa83310fd2 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:25.409030 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a7a199ed-96d2-4c14-bc71-75fa83310fd2 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:25.409468 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a7a199ed-96d2-4c14-bc71-75fa83310fd2 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:25.544058 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-a7a199ed-96d2-4c14-bc71-75fa83310fd2 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:25.547596 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=100 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:04:25.551929 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-a7a199ed-96d2-4c14-bc71-75fa83310fd2 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2" status: 200 len: 1321 microversion: 2.1 time: 0.167082 Aug 11 11:04:25.552486 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 63/118] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:25 2022] GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2 => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:04:25.580016 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-dd595315-befe-4b26-8630-45a99c62a608 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:25.580016 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-dd595315-befe-4b26-8630-45a99c62a608 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] [instance: 89f57d2f-28f8-4ad2-8b20-e6533726993b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:25.580016 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-dd595315-befe-4b26-8630-45a99c62a608 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:25.580016 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-dd595315-befe-4b26-8630-45a99c62a608 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:25.580762 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-dd595315-befe-4b26-8630-45a99c62a608 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:25.581139 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-dd595315-befe-4b26-8630-45a99c62a608 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:25.581680 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-dd595315-befe-4b26-8630-45a99c62a608 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:25.582016 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-dd595315-befe-4b26-8630-45a99c62a608 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:25.731719 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-dd595315-befe-4b26-8630-45a99c62a608 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6fc583bb8a4434b0c6538c9ffbde75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb076c769694966bbfea2f23ea8b8a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:25.741509 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-dd595315-befe-4b26-8630-45a99c62a608 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] 10.222.0.48 "GET /compute/v2.1/servers/89f57d2f-28f8-4ad2-8b20-e6533726993b" status: 200 len: 1314 microversion: 2.1 time: 0.174666 Aug 11 11:04:25.742086 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 56/119] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:25 2022] GET /compute/v2.1/servers/89f57d2f-28f8-4ad2-8b20-e6533726993b => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:04:26.036864 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-ae2536f5-b1f3-46d3-a3b1-fc9ceac55345 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:26.037624 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-ae2536f5-b1f3-46d3-a3b1-fc9ceac55345 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:26.045423 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ae2536f5-b1f3-46d3-a3b1-fc9ceac55345 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:26.046198 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ae2536f5-b1f3-46d3-a3b1-fc9ceac55345 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:26.046800 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ae2536f5-b1f3-46d3-a3b1-fc9ceac55345 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:26.047490 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ae2536f5-b1f3-46d3-a3b1-fc9ceac55345 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:26.048006 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ae2536f5-b1f3-46d3-a3b1-fc9ceac55345 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:26.048389 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ae2536f5-b1f3-46d3-a3b1-fc9ceac55345 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:26.152907 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-857cb474-5379-4c31-ab51-699a09553c2c tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:26.154568 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-857cb474-5379-4c31-ab51-699a09553c2c tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:26.158407 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell0:SELECT=2 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:04:26.167214 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-857cb474-5379-4c31-ab51-699a09553c2c tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:26.167749 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-857cb474-5379-4c31-ab51-699a09553c2c tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:26.168223 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-857cb474-5379-4c31-ab51-699a09553c2c tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:26.168929 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-857cb474-5379-4c31-ab51-699a09553c2c tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:26.169382 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-857cb474-5379-4c31-ab51-699a09553c2c tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:26.170987 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-857cb474-5379-4c31-ab51-699a09553c2c tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:26.248216 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-ae2536f5-b1f3-46d3-a3b1-fc9ceac55345 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:26.256640 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-ae2536f5-b1f3-46d3-a3b1-fc9ceac55345 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:26.258630 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-ae2536f5-b1f3-46d3-a3b1-fc9ceac55345 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:26.259888 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-ae2536f5-b1f3-46d3-a3b1-fc9ceac55345 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1404 microversion: 2.20 time: 0.227207 Aug 11 11:04:26.260453 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 64/120] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:04:26 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1404 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:04:26.323139 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-857cb474-5379-4c31-ab51-699a09553c2c tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:26.328715 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-857cb474-5379-4c31-ab51-699a09553c2c tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1362 microversion: 2.1 time: 0.181785 Aug 11 11:04:26.329924 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 57/121] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:26 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1362 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:04:26.574789 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-56d15b8c-a445-416d-9da6-e8ac4a360b12 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:26.575857 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-56d15b8c-a445-416d-9da6-e8ac4a360b12 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: a09cb964-88a4-4fad-ae60-efb0a7a7dec2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:26.582715 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-56d15b8c-a445-416d-9da6-e8ac4a360b12 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:26.583289 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-56d15b8c-a445-416d-9da6-e8ac4a360b12 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:26.583992 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-56d15b8c-a445-416d-9da6-e8ac4a360b12 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:26.590865 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-56d15b8c-a445-416d-9da6-e8ac4a360b12 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:26.591696 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-56d15b8c-a445-416d-9da6-e8ac4a360b12 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:26.592396 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-56d15b8c-a445-416d-9da6-e8ac4a360b12 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:26.761659 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-56d15b8c-a445-416d-9da6-e8ac4a360b12 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:26.767048 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-7b281646-3fc2-4250-8de3-5ea8a94e4682 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:26.770060 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-7b281646-3fc2-4250-8de3-5ea8a94e4682 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] [instance: 89f57d2f-28f8-4ad2-8b20-e6533726993b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:26.775961 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-56d15b8c-a445-416d-9da6-e8ac4a360b12 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2" status: 200 len: 1321 microversion: 2.1 time: 0.205521 Aug 11 11:04:26.778355 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 65/122] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:26 2022] GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2 => generated 1321 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:04:26.779630 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7b281646-3fc2-4250-8de3-5ea8a94e4682 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:26.780157 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7b281646-3fc2-4250-8de3-5ea8a94e4682 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:26.780593 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7b281646-3fc2-4250-8de3-5ea8a94e4682 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:26.781325 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7b281646-3fc2-4250-8de3-5ea8a94e4682 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:26.782981 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7b281646-3fc2-4250-8de3-5ea8a94e4682 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:26.782981 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7b281646-3fc2-4250-8de3-5ea8a94e4682 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:26.933566 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-7b281646-3fc2-4250-8de3-5ea8a94e4682 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6fc583bb8a4434b0c6538c9ffbde75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb076c769694966bbfea2f23ea8b8a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:26.942165 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-7b281646-3fc2-4250-8de3-5ea8a94e4682 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] 10.222.0.48 "GET /compute/v2.1/servers/89f57d2f-28f8-4ad2-8b20-e6533726993b" status: 200 len: 1314 microversion: 2.1 time: 0.182773 Aug 11 11:04:26.947956 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 58/123] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:26 2022] GET /compute/v2.1/servers/89f57d2f-28f8-4ad2-8b20-e6533726993b => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:04:27.282868 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-b91ced47-483b-42ad-9f4f-93c76bbd5523 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:27.283464 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-b91ced47-483b-42ad-9f4f-93c76bbd5523 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:27.289891 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b91ced47-483b-42ad-9f4f-93c76bbd5523 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:27.290372 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b91ced47-483b-42ad-9f4f-93c76bbd5523 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:27.290812 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b91ced47-483b-42ad-9f4f-93c76bbd5523 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:27.292074 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b91ced47-483b-42ad-9f4f-93c76bbd5523 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:27.292528 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b91ced47-483b-42ad-9f4f-93c76bbd5523 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:27.292944 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b91ced47-483b-42ad-9f4f-93c76bbd5523 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:27.350268 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-a705f9b1-2e61-4fd0-b786-f2415174aa38 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:27.350863 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-a705f9b1-2e61-4fd0-b786-f2415174aa38 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:27.357942 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a705f9b1-2e61-4fd0-b786-f2415174aa38 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:27.358421 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a705f9b1-2e61-4fd0-b786-f2415174aa38 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:27.358850 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a705f9b1-2e61-4fd0-b786-f2415174aa38 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:27.359541 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a705f9b1-2e61-4fd0-b786-f2415174aa38 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:27.360031 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a705f9b1-2e61-4fd0-b786-f2415174aa38 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:27.360446 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a705f9b1-2e61-4fd0-b786-f2415174aa38 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:27.385083 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell1:SELECT=100 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:04:27.660985 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-b91ced47-483b-42ad-9f4f-93c76bbd5523 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:27.684720 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-b91ced47-483b-42ad-9f4f-93c76bbd5523 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:27.684720 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-b91ced47-483b-42ad-9f4f-93c76bbd5523 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:27.684720 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-b91ced47-483b-42ad-9f4f-93c76bbd5523 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1404 microversion: 2.20 time: 0.392754 Aug 11 11:04:27.685120 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 66/124] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:04:27 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1404 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 11:04:27.685218 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-a705f9b1-2e61-4fd0-b786-f2415174aa38 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:27.685218 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-a705f9b1-2e61-4fd0-b786-f2415174aa38 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1362 microversion: 2.1 time: 0.337022 Aug 11 11:04:27.685218 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 59/125] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:27 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1362 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:04:27.801520 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-1f93f355-442b-4315-a21d-5bfee513af66 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:27.802530 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-1f93f355-442b-4315-a21d-5bfee513af66 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: a09cb964-88a4-4fad-ae60-efb0a7a7dec2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:27.813252 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1f93f355-442b-4315-a21d-5bfee513af66 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:27.814046 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1f93f355-442b-4315-a21d-5bfee513af66 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:27.814742 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1f93f355-442b-4315-a21d-5bfee513af66 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:27.815893 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1f93f355-442b-4315-a21d-5bfee513af66 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:27.816731 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1f93f355-442b-4315-a21d-5bfee513af66 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:27.817652 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1f93f355-442b-4315-a21d-5bfee513af66 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:27.970850 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-271e7bed-7671-48cc-81d9-67299bce2497 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:27.972320 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-271e7bed-7671-48cc-81d9-67299bce2497 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] [instance: 89f57d2f-28f8-4ad2-8b20-e6533726993b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:27.981981 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-1f93f355-442b-4315-a21d-5bfee513af66 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:27.990369 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-271e7bed-7671-48cc-81d9-67299bce2497 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:27.992229 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-271e7bed-7671-48cc-81d9-67299bce2497 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:27.992808 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-271e7bed-7671-48cc-81d9-67299bce2497 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:27.993789 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-271e7bed-7671-48cc-81d9-67299bce2497 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:27.997314 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-271e7bed-7671-48cc-81d9-67299bce2497 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:27.997983 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-271e7bed-7671-48cc-81d9-67299bce2497 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:28.003892 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-1f93f355-442b-4315-a21d-5bfee513af66 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2" status: 200 len: 1321 microversion: 2.1 time: 0.208498 Aug 11 11:04:28.006632 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 67/126] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:27 2022] GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2 => generated 1321 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:04:28.158177 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-271e7bed-7671-48cc-81d9-67299bce2497 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6fc583bb8a4434b0c6538c9ffbde75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb076c769694966bbfea2f23ea8b8a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:28.167080 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-271e7bed-7671-48cc-81d9-67299bce2497 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] 10.222.0.48 "GET /compute/v2.1/servers/89f57d2f-28f8-4ad2-8b20-e6533726993b" status: 200 len: 1314 microversion: 2.1 time: 0.202864 Aug 11 11:04:28.167793 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 60/127] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:27 2022] GET /compute/v2.1/servers/89f57d2f-28f8-4ad2-8b20-e6533726993b => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:04:28.702652 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-eb1f0321-fccb-4d4a-bedc-9a389c036929 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:28.702652 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-eb1f0321-fccb-4d4a-bedc-9a389c036929 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:28.705240 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-66fe46d2-3569-4169-bc8e-809b5579ad5f tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:28.705894 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-66fe46d2-3569-4169-bc8e-809b5579ad5f tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:28.707680 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-eb1f0321-fccb-4d4a-bedc-9a389c036929 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:28.708621 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-eb1f0321-fccb-4d4a-bedc-9a389c036929 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:28.709503 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-eb1f0321-fccb-4d4a-bedc-9a389c036929 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:28.710761 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-eb1f0321-fccb-4d4a-bedc-9a389c036929 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:28.711212 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-eb1f0321-fccb-4d4a-bedc-9a389c036929 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:28.711823 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-eb1f0321-fccb-4d4a-bedc-9a389c036929 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:28.715278 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-66fe46d2-3569-4169-bc8e-809b5579ad5f tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:28.715960 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-66fe46d2-3569-4169-bc8e-809b5579ad5f tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:28.717877 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-66fe46d2-3569-4169-bc8e-809b5579ad5f tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:28.719233 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-66fe46d2-3569-4169-bc8e-809b5579ad5f tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:28.719884 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-66fe46d2-3569-4169-bc8e-809b5579ad5f tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:28.720478 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-66fe46d2-3569-4169-bc8e-809b5579ad5f tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:29.015831 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-eb1f0321-fccb-4d4a-bedc-9a389c036929 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:29.025886 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-eb1f0321-fccb-4d4a-bedc-9a389c036929 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:29.028154 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-eb1f0321-fccb-4d4a-bedc-9a389c036929 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:29.029254 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-66fe46d2-3569-4169-bc8e-809b5579ad5f tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:29.030244 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-eb1f0321-fccb-4d4a-bedc-9a389c036929 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1404 microversion: 2.20 time: 0.335189 Aug 11 11:04:29.031324 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 68/128] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:04:28 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1404 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:04:29.046639 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-66fe46d2-3569-4169-bc8e-809b5579ad5f tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1362 microversion: 2.1 time: 0.345924 Aug 11 11:04:29.047222 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 61/129] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:28 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1362 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:04:29.057172 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-caf6765b-41de-4e8a-b3e2-0aebc9a44319 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:29.057776 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-caf6765b-41de-4e8a-b3e2-0aebc9a44319 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: a09cb964-88a4-4fad-ae60-efb0a7a7dec2] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:29.072792 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-caf6765b-41de-4e8a-b3e2-0aebc9a44319 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:29.073215 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-caf6765b-41de-4e8a-b3e2-0aebc9a44319 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:29.073778 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-caf6765b-41de-4e8a-b3e2-0aebc9a44319 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:29.074641 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-caf6765b-41de-4e8a-b3e2-0aebc9a44319 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:29.075115 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-caf6765b-41de-4e8a-b3e2-0aebc9a44319 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:29.075648 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-caf6765b-41de-4e8a-b3e2-0aebc9a44319 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:29.120356 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-13102401-147c-41a3-91ba-92afdafba0cd req-a5503cf0-237e-4f75-bcaa-8f8a3aed3d58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1797716b-0533-42be-8c06-750959aaf935", "name": "network-vif-plugged", "status": "completed", "tag": "6848a700-8424-47d3-8492-918f43aa51ad"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:04:29.141284 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-13102401-147c-41a3-91ba-92afdafba0cd req-a5503cf0-237e-4f75-bcaa-8f8a3aed3d58 service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:29.144457 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-13102401-147c-41a3-91ba-92afdafba0cd req-a5503cf0-237e-4f75-bcaa-8f8a3aed3d58 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:29.145281 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-13102401-147c-41a3-91ba-92afdafba0cd req-a5503cf0-237e-4f75-bcaa-8f8a3aed3d58 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:29.158274 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-13102401-147c-41a3-91ba-92afdafba0cd req-a5503cf0-237e-4f75-bcaa-8f8a3aed3d58 service nova] Creating event network-vif-plugged:6848a700-8424-47d3-8492-918f43aa51ad for instance 1797716b-0533-42be-8c06-750959aaf935 on hv-cinder-82002 Aug 11 11:04:29.163444 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-13102401-147c-41a3-91ba-92afdafba0cd req-a5503cf0-237e-4f75-bcaa-8f8a3aed3d58 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130760 Aug 11 11:04:29.164334 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 69/130] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:04:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:04:29.207161 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-bea7c200-2492-4f2c-b75b-fa34155d99cf tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:29.209834 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-bea7c200-2492-4f2c-b75b-fa34155d99cf tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] [instance: 89f57d2f-28f8-4ad2-8b20-e6533726993b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:29.222217 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bea7c200-2492-4f2c-b75b-fa34155d99cf tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:29.222945 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bea7c200-2492-4f2c-b75b-fa34155d99cf tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:29.223614 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bea7c200-2492-4f2c-b75b-fa34155d99cf tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:29.224477 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bea7c200-2492-4f2c-b75b-fa34155d99cf tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:29.225115 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bea7c200-2492-4f2c-b75b-fa34155d99cf tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:29.225755 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bea7c200-2492-4f2c-b75b-fa34155d99cf tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:29.236107 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-caf6765b-41de-4e8a-b3e2-0aebc9a44319 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:29.246217 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-caf6765b-41de-4e8a-b3e2-0aebc9a44319 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2" status: 200 len: 1321 microversion: 2.1 time: 0.192116 Aug 11 11:04:29.257988 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 62/131] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:29 2022] GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2 => generated 1321 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:04:29.500318 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-bea7c200-2492-4f2c-b75b-fa34155d99cf tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6fc583bb8a4434b0c6538c9ffbde75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb076c769694966bbfea2f23ea8b8a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:29.514054 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-bea7c200-2492-4f2c-b75b-fa34155d99cf tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] 10.222.0.48 "GET /compute/v2.1/servers/89f57d2f-28f8-4ad2-8b20-e6533726993b" status: 200 len: 1314 microversion: 2.1 time: 0.317130 Aug 11 11:04:29.527365 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 70/132] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:29 2022] GET /compute/v2.1/servers/89f57d2f-28f8-4ad2-8b20-e6533726993b => generated 1314 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:04:30.054515 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-fe35f8b7-936e-4293-b094-383841471766 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:30.055043 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-fe35f8b7-936e-4293-b094-383841471766 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:30.061685 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fe35f8b7-936e-4293-b094-383841471766 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:30.062163 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fe35f8b7-936e-4293-b094-383841471766 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:30.062592 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fe35f8b7-936e-4293-b094-383841471766 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:30.063261 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fe35f8b7-936e-4293-b094-383841471766 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:30.063711 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fe35f8b7-936e-4293-b094-383841471766 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:30.064150 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fe35f8b7-936e-4293-b094-383841471766 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:30.067083 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-961f9ae4-dffb-4779-9554-959724f3b656 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:30.067783 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-961f9ae4-dffb-4779-9554-959724f3b656 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:30.076558 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-961f9ae4-dffb-4779-9554-959724f3b656 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:30.077046 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-961f9ae4-dffb-4779-9554-959724f3b656 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:30.077478 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-961f9ae4-dffb-4779-9554-959724f3b656 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:30.078236 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-961f9ae4-dffb-4779-9554-959724f3b656 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:30.078682 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-961f9ae4-dffb-4779-9554-959724f3b656 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:30.079303 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-961f9ae4-dffb-4779-9554-959724f3b656 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:30.270504 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-fe35f8b7-936e-4293-b094-383841471766 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:30.279418 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-961f9ae4-dffb-4779-9554-959724f3b656 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:30.283084 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-fe35f8b7-936e-4293-b094-383841471766 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:30.284639 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-fe35f8b7-936e-4293-b094-383841471766 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:30.285888 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-fe35f8b7-936e-4293-b094-383841471766 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1404 microversion: 2.20 time: 0.235274 Aug 11 11:04:30.286453 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 63/133] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:04:30 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1404 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:04:30.286631 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-961f9ae4-dffb-4779-9554-959724f3b656 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1362 microversion: 2.1 time: 0.223151 Aug 11 11:04:30.292618 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 71/134] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:30 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1362 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:04:30.300644 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-a976ae3a-adda-4e6f-8e6b-86dfb18397c6 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:30.301293 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-a976ae3a-adda-4e6f-8e6b-86dfb18397c6 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: a09cb964-88a4-4fad-ae60-efb0a7a7dec2] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:30.309522 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a976ae3a-adda-4e6f-8e6b-86dfb18397c6 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:30.310128 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a976ae3a-adda-4e6f-8e6b-86dfb18397c6 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:30.310571 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a976ae3a-adda-4e6f-8e6b-86dfb18397c6 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:30.311274 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a976ae3a-adda-4e6f-8e6b-86dfb18397c6 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:30.311732 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a976ae3a-adda-4e6f-8e6b-86dfb18397c6 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:30.312283 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a976ae3a-adda-4e6f-8e6b-86dfb18397c6 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:30.461935 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-a976ae3a-adda-4e6f-8e6b-86dfb18397c6 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:30.469557 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-a976ae3a-adda-4e6f-8e6b-86dfb18397c6 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2" status: 200 len: 1321 microversion: 2.1 time: 0.181765 Aug 11 11:04:30.470126 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 64/135] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:30 2022] GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2 => generated 1321 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:04:30.554030 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-505c26eb-c5c5-4d30-a9a1-586d5cadcc7c tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:30.557912 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-505c26eb-c5c5-4d30-a9a1-586d5cadcc7c tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] [instance: 89f57d2f-28f8-4ad2-8b20-e6533726993b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:30.569806 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-505c26eb-c5c5-4d30-a9a1-586d5cadcc7c tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:30.570433 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-505c26eb-c5c5-4d30-a9a1-586d5cadcc7c tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:30.571500 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-505c26eb-c5c5-4d30-a9a1-586d5cadcc7c tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:30.572606 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-505c26eb-c5c5-4d30-a9a1-586d5cadcc7c tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:30.573340 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-505c26eb-c5c5-4d30-a9a1-586d5cadcc7c tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:30.573951 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-505c26eb-c5c5-4d30-a9a1-586d5cadcc7c tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:30.776236 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-505c26eb-c5c5-4d30-a9a1-586d5cadcc7c tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6fc583bb8a4434b0c6538c9ffbde75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb076c769694966bbfea2f23ea8b8a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:30.783829 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-505c26eb-c5c5-4d30-a9a1-586d5cadcc7c tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] 10.222.0.48 "GET /compute/v2.1/servers/89f57d2f-28f8-4ad2-8b20-e6533726993b" status: 200 len: 1314 microversion: 2.1 time: 0.237987 Aug 11 11:04:30.784403 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 72/136] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:30 2022] GET /compute/v2.1/servers/89f57d2f-28f8-4ad2-8b20-e6533726993b => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:04:31.202233 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-f6fdccd0-980f-40db-97cc-f88fc546ff06 req-a8f3385b-94e0-44aa-8638-f56f640f5df2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89f57d2f-28f8-4ad2-8b20-e6533726993b", "name": "network-vif-plugged", "status": "completed", "tag": "88fbb9e2-cef3-480b-b104-e4319e0404cb"}, {"server_uuid": "82a61cf6-1f3f-4ced-9806-a06252b9b2cc", "name": "network-vif-plugged", "status": "completed", "tag": "71bca2c4-19df-4dc2-ad61-c7058687c043"}, {"server_uuid": "a09cb964-88a4-4fad-ae60-efb0a7a7dec2", "name": "network-vif-plugged", "status": "completed", "tag": "1fe4417c-0d11-448d-803e-4fef1c525582"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:04:31.241086 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-f6fdccd0-980f-40db-97cc-f88fc546ff06 req-a8f3385b-94e0-44aa-8638-f56f640f5df2 service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:31.241808 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-f6fdccd0-980f-40db-97cc-f88fc546ff06 req-a8f3385b-94e0-44aa-8638-f56f640f5df2 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:31.242056 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-f6fdccd0-980f-40db-97cc-f88fc546ff06 req-a8f3385b-94e0-44aa-8638-f56f640f5df2 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:31.265452 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-f6fdccd0-980f-40db-97cc-f88fc546ff06 req-a8f3385b-94e0-44aa-8638-f56f640f5df2 service nova] Creating event network-vif-plugged:88fbb9e2-cef3-480b-b104-e4319e0404cb for instance 89f57d2f-28f8-4ad2-8b20-e6533726993b on hv-cinder-82002 Aug 11 11:04:31.266097 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-f6fdccd0-980f-40db-97cc-f88fc546ff06 req-a8f3385b-94e0-44aa-8638-f56f640f5df2 service nova] Creating event network-vif-plugged:71bca2c4-19df-4dc2-ad61-c7058687c043 for instance 82a61cf6-1f3f-4ced-9806-a06252b9b2cc on hv-cinder-82002 Aug 11 11:04:31.266668 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-f6fdccd0-980f-40db-97cc-f88fc546ff06 req-a8f3385b-94e0-44aa-8638-f56f640f5df2 service nova] Creating event network-vif-plugged:1fe4417c-0d11-448d-803e-4fef1c525582 for instance a09cb964-88a4-4fad-ae60-efb0a7a7dec2 on hv-cinder-82002 Aug 11 11:04:31.275452 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-f6fdccd0-980f-40db-97cc-f88fc546ff06 req-a8f3385b-94e0-44aa-8638-f56f640f5df2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.078103 Aug 11 11:04:31.276340 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 65/137] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:04:31 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:04:31.307342 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-0801fde7-5521-4d35-b789-7b9bac443a3a tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:31.308014 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-0801fde7-5521-4d35-b789-7b9bac443a3a tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:31.309409 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-7b7583d7-276f-444a-8047-aa41b0d9d48a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:31.310124 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-7b7583d7-276f-444a-8047-aa41b0d9d48a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:31.314580 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0801fde7-5521-4d35-b789-7b9bac443a3a tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:31.315079 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0801fde7-5521-4d35-b789-7b9bac443a3a tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:31.315520 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0801fde7-5521-4d35-b789-7b9bac443a3a tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:31.316217 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7b7583d7-276f-444a-8047-aa41b0d9d48a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:31.316324 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0801fde7-5521-4d35-b789-7b9bac443a3a tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:31.316680 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0801fde7-5521-4d35-b789-7b9bac443a3a tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:31.316795 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7b7583d7-276f-444a-8047-aa41b0d9d48a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:31.317107 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0801fde7-5521-4d35-b789-7b9bac443a3a tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:31.317214 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7b7583d7-276f-444a-8047-aa41b0d9d48a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:31.317782 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7b7583d7-276f-444a-8047-aa41b0d9d48a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:31.318236 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7b7583d7-276f-444a-8047-aa41b0d9d48a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:31.318664 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7b7583d7-276f-444a-8047-aa41b0d9d48a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:31.594679 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-0801fde7-5521-4d35-b789-7b9bac443a3a tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:31.599839 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-7b7583d7-276f-444a-8047-aa41b0d9d48a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:31.607936 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-0801fde7-5521-4d35-b789-7b9bac443a3a tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1362 microversion: 2.1 time: 0.305003 Aug 11 11:04:31.609619 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 73/138] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:31 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1362 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:04:31.610085 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-7b7583d7-276f-444a-8047-aa41b0d9d48a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:31.611795 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-7b7583d7-276f-444a-8047-aa41b0d9d48a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:31.612973 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-7b7583d7-276f-444a-8047-aa41b0d9d48a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1404 microversion: 2.20 time: 0.308706 Aug 11 11:04:31.617952 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-d4801202-557a-4519-943c-bf3563862be3 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:31.620453 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-d4801202-557a-4519-943c-bf3563862be3 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: a09cb964-88a4-4fad-ae60-efb0a7a7dec2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:31.629085 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d4801202-557a-4519-943c-bf3563862be3 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:31.630445 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d4801202-557a-4519-943c-bf3563862be3 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:31.631293 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d4801202-557a-4519-943c-bf3563862be3 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:31.633334 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d4801202-557a-4519-943c-bf3563862be3 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:31.634097 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d4801202-557a-4519-943c-bf3563862be3 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:31.635556 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 66/139] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:04:31 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1404 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 11:04:31.637130 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d4801202-557a-4519-943c-bf3563862be3 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:31.805941 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-8d67c8bb-3c80-45fc-9bc3-58e0704f5a17 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:31.807118 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-8d67c8bb-3c80-45fc-9bc3-58e0704f5a17 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] [instance: 89f57d2f-28f8-4ad2-8b20-e6533726993b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:31.813904 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8d67c8bb-3c80-45fc-9bc3-58e0704f5a17 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:31.814458 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8d67c8bb-3c80-45fc-9bc3-58e0704f5a17 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:31.814884 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8d67c8bb-3c80-45fc-9bc3-58e0704f5a17 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:31.815731 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8d67c8bb-3c80-45fc-9bc3-58e0704f5a17 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:31.816358 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8d67c8bb-3c80-45fc-9bc3-58e0704f5a17 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:31.816919 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8d67c8bb-3c80-45fc-9bc3-58e0704f5a17 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:31.826892 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d4801202-557a-4519-943c-bf3563862be3 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:31.836979 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-d4801202-557a-4519-943c-bf3563862be3 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2" status: 200 len: 1321 microversion: 2.1 time: 0.224756 Aug 11 11:04:31.838552 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 74/140] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:31 2022] GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2 => generated 1321 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:04:32.016749 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-8d67c8bb-3c80-45fc-9bc3-58e0704f5a17 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6fc583bb8a4434b0c6538c9ffbde75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb076c769694966bbfea2f23ea8b8a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:32.024357 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-8d67c8bb-3c80-45fc-9bc3-58e0704f5a17 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] 10.222.0.48 "GET /compute/v2.1/servers/89f57d2f-28f8-4ad2-8b20-e6533726993b" status: 200 len: 1314 microversion: 2.1 time: 0.222787 Aug 11 11:04:32.025542 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 67/141] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:31 2022] GET /compute/v2.1/servers/89f57d2f-28f8-4ad2-8b20-e6533726993b => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:04:32.629125 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-90b419e9-2ddd-41e1-b257-99bcba45b3fa tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:32.630334 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-90b419e9-2ddd-41e1-b257-99bcba45b3fa tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:32.641109 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-90b419e9-2ddd-41e1-b257-99bcba45b3fa tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:32.641806 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-90b419e9-2ddd-41e1-b257-99bcba45b3fa tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:32.642232 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-fa0f25a2-27bd-41dc-bc61-9c9da739669f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:32.642680 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-90b419e9-2ddd-41e1-b257-99bcba45b3fa tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:32.642838 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-fa0f25a2-27bd-41dc-bc61-9c9da739669f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:32.642970 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-90b419e9-2ddd-41e1-b257-99bcba45b3fa tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:32.643364 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-90b419e9-2ddd-41e1-b257-99bcba45b3fa tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:32.643987 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-90b419e9-2ddd-41e1-b257-99bcba45b3fa tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:32.650288 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fa0f25a2-27bd-41dc-bc61-9c9da739669f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:32.650288 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fa0f25a2-27bd-41dc-bc61-9c9da739669f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:32.650533 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fa0f25a2-27bd-41dc-bc61-9c9da739669f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:32.651071 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fa0f25a2-27bd-41dc-bc61-9c9da739669f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:32.651514 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fa0f25a2-27bd-41dc-bc61-9c9da739669f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:32.652441 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fa0f25a2-27bd-41dc-bc61-9c9da739669f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:32.856634 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-fa0f25a2-27bd-41dc-bc61-9c9da739669f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:32.857985 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-90b419e9-2ddd-41e1-b257-99bcba45b3fa tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:32.868466 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-90b419e9-2ddd-41e1-b257-99bcba45b3fa tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1549 microversion: 2.1 time: 0.242857 Aug 11 11:04:32.869919 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-fa0f25a2-27bd-41dc-bc61-9c9da739669f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:32.870559 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 75/142] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:32 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1549 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:04:32.873067 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-fa0f25a2-27bd-41dc-bc61-9c9da739669f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:32.874728 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-fa0f25a2-27bd-41dc-bc61-9c9da739669f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1404 microversion: 2.20 time: 0.236098 Aug 11 11:04:32.875998 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-ea031b6d-37fa-4f31-8316-f5a8e3989a36 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:32.876386 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 68/143] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:04:32 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1404 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 11:04:32.876736 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-ea031b6d-37fa-4f31-8316-f5a8e3989a36 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: a09cb964-88a4-4fad-ae60-efb0a7a7dec2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:32.882816 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ea031b6d-37fa-4f31-8316-f5a8e3989a36 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:32.883421 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ea031b6d-37fa-4f31-8316-f5a8e3989a36 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:32.886003 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ea031b6d-37fa-4f31-8316-f5a8e3989a36 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:32.887160 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ea031b6d-37fa-4f31-8316-f5a8e3989a36 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:32.887631 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ea031b6d-37fa-4f31-8316-f5a8e3989a36 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:32.892517 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-3e0dfdba-7bec-48fb-a0f9-2f07503e0b04 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:32.893220 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-3e0dfdba-7bec-48fb-a0f9-2f07503e0b04 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:32.899492 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3e0dfdba-7bec-48fb-a0f9-2f07503e0b04 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:32.900305 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3e0dfdba-7bec-48fb-a0f9-2f07503e0b04 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:32.900951 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3e0dfdba-7bec-48fb-a0f9-2f07503e0b04 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:32.901827 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3e0dfdba-7bec-48fb-a0f9-2f07503e0b04 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:32.902038 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ea031b6d-37fa-4f31-8316-f5a8e3989a36 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:32.902932 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3e0dfdba-7bec-48fb-a0f9-2f07503e0b04 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:32.903543 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3e0dfdba-7bec-48fb-a0f9-2f07503e0b04 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:33.089511 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-3e0dfdba-7bec-48fb-a0f9-2f07503e0b04 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.202976 Aug 11 11:04:33.090695 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 69/144] 10.222.0.48 () {58 vars in 1275 bytes} [Thu Aug 11 11:04:32 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935/os-interface => generated 285 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 11:04:33.096917 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-7caeb745-74fc-4ae5-b76a-e827e56c9a76 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:33.097797 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-7caeb745-74fc-4ae5-b76a-e827e56c9a76 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] [instance: 89f57d2f-28f8-4ad2-8b20-e6533726993b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:33.115661 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7caeb745-74fc-4ae5-b76a-e827e56c9a76 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:33.119030 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7caeb745-74fc-4ae5-b76a-e827e56c9a76 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:33.119735 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7caeb745-74fc-4ae5-b76a-e827e56c9a76 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:33.122119 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7caeb745-74fc-4ae5-b76a-e827e56c9a76 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:33.123092 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7caeb745-74fc-4ae5-b76a-e827e56c9a76 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:33.124822 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7caeb745-74fc-4ae5-b76a-e827e56c9a76 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:33.133528 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-ea031b6d-37fa-4f31-8316-f5a8e3989a36 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:33.142429 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-ea031b6d-37fa-4f31-8316-f5a8e3989a36 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2" status: 200 len: 1321 microversion: 2.1 time: 0.270749 Aug 11 11:04:33.145540 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 76/145] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:32 2022] GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2 => generated 1321 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:04:33.277291 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-7caeb745-74fc-4ae5-b76a-e827e56c9a76 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6fc583bb8a4434b0c6538c9ffbde75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb076c769694966bbfea2f23ea8b8a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:33.285395 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-7caeb745-74fc-4ae5-b76a-e827e56c9a76 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] 10.222.0.48 "GET /compute/v2.1/servers/89f57d2f-28f8-4ad2-8b20-e6533726993b" status: 200 len: 1314 microversion: 2.1 time: 0.192938 Aug 11 11:04:33.291303 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 70/146] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:33 2022] GET /compute/v2.1/servers/89f57d2f-28f8-4ad2-8b20-e6533726993b => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:04:33.292301 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-615bebfa-e503-446d-9250-48905c0434e3 req-2e2115b3-68a3-46b6-9011-5a675cc674c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cfaa606-ef7e-4594-aaba-72be96386bd7", "name": "network-vif-plugged", "status": "completed", "tag": "62264662-0d46-4c8b-8645-6e11bfc09892"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:04:33.305213 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-615bebfa-e503-446d-9250-48905c0434e3 req-2e2115b3-68a3-46b6-9011-5a675cc674c7 service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:33.306494 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-615bebfa-e503-446d-9250-48905c0434e3 req-2e2115b3-68a3-46b6-9011-5a675cc674c7 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:33.307332 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-615bebfa-e503-446d-9250-48905c0434e3 req-2e2115b3-68a3-46b6-9011-5a675cc674c7 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:33.325021 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-615bebfa-e503-446d-9250-48905c0434e3 req-2e2115b3-68a3-46b6-9011-5a675cc674c7 service nova] Creating event network-vif-plugged:62264662-0d46-4c8b-8645-6e11bfc09892 for instance 7cfaa606-ef7e-4594-aaba-72be96386bd7 on hv-cinder-82002 Aug 11 11:04:33.331731 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-615bebfa-e503-446d-9250-48905c0434e3 req-2e2115b3-68a3-46b6-9011-5a675cc674c7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043061 Aug 11 11:04:33.333268 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 77/147] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:04:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:04:33.901666 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-e2b5a7b0-89ef-42e8-b87f-8a2a417f75bf tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:33.902856 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-e2b5a7b0-89ef-42e8-b87f-8a2a417f75bf tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:33.909135 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e2b5a7b0-89ef-42e8-b87f-8a2a417f75bf tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:33.909827 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e2b5a7b0-89ef-42e8-b87f-8a2a417f75bf tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:33.910413 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e2b5a7b0-89ef-42e8-b87f-8a2a417f75bf tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:33.911264 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e2b5a7b0-89ef-42e8-b87f-8a2a417f75bf tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:33.911912 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e2b5a7b0-89ef-42e8-b87f-8a2a417f75bf tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:33.912536 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e2b5a7b0-89ef-42e8-b87f-8a2a417f75bf tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:34.149592 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-e2b5a7b0-89ef-42e8-b87f-8a2a417f75bf tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:34.158237 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-e2b5a7b0-89ef-42e8-b87f-8a2a417f75bf tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:34.160089 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-e2b5a7b0-89ef-42e8-b87f-8a2a417f75bf tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:34.161721 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-e2b5a7b0-89ef-42e8-b87f-8a2a417f75bf tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1404 microversion: 2.20 time: 0.264456 Aug 11 11:04:34.163170 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 71/148] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:04:33 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1404 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:04:34.166267 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-fff15574-b45c-43c0-a5ac-55b23d4e9fe0 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:34.167151 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-fff15574-b45c-43c0-a5ac-55b23d4e9fe0 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: a09cb964-88a4-4fad-ae60-efb0a7a7dec2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:34.176474 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fff15574-b45c-43c0-a5ac-55b23d4e9fe0 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:34.177395 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fff15574-b45c-43c0-a5ac-55b23d4e9fe0 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:34.177948 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fff15574-b45c-43c0-a5ac-55b23d4e9fe0 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:34.178721 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fff15574-b45c-43c0-a5ac-55b23d4e9fe0 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:34.179239 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fff15574-b45c-43c0-a5ac-55b23d4e9fe0 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:34.186539 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fff15574-b45c-43c0-a5ac-55b23d4e9fe0 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:34.317092 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-b693fa8a-062e-4780-80c0-43a6a016299d tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:34.319553 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-b693fa8a-062e-4780-80c0-43a6a016299d tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] [instance: 89f57d2f-28f8-4ad2-8b20-e6533726993b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:34.335889 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b693fa8a-062e-4780-80c0-43a6a016299d tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:34.335889 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b693fa8a-062e-4780-80c0-43a6a016299d tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:34.335889 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b693fa8a-062e-4780-80c0-43a6a016299d tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:34.335889 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b693fa8a-062e-4780-80c0-43a6a016299d tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:34.336218 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b693fa8a-062e-4780-80c0-43a6a016299d tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:34.336218 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b693fa8a-062e-4780-80c0-43a6a016299d tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:34.361985 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-fff15574-b45c-43c0-a5ac-55b23d4e9fe0 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:34.380148 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-fff15574-b45c-43c0-a5ac-55b23d4e9fe0 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2" status: 200 len: 1321 microversion: 2.1 time: 0.219033 Aug 11 11:04:34.381178 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 78/149] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:34 2022] GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2 => generated 1321 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:04:34.533290 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-b693fa8a-062e-4780-80c0-43a6a016299d tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6fc583bb8a4434b0c6538c9ffbde75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb076c769694966bbfea2f23ea8b8a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:34.541593 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-b693fa8a-062e-4780-80c0-43a6a016299d tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] 10.222.0.48 "GET /compute/v2.1/servers/89f57d2f-28f8-4ad2-8b20-e6533726993b" status: 200 len: 1314 microversion: 2.1 time: 0.232724 Aug 11 11:04:34.544437 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 72/150] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:34 2022] GET /compute/v2.1/servers/89f57d2f-28f8-4ad2-8b20-e6533726993b => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:04:34.862309 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-b02b08ad-437f-447c-a7b9-a9cd70ee3ad5 req-314974f9-171b-4d59-8c17-aeb0d3370939 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1797716b-0533-42be-8c06-750959aaf935", "tag": "6848a700-8424-47d3-8492-918f43aa51ad"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:04:34.870645 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-b02b08ad-437f-447c-a7b9-a9cd70ee3ad5 req-314974f9-171b-4d59-8c17-aeb0d3370939 service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:34.871639 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-b02b08ad-437f-447c-a7b9-a9cd70ee3ad5 req-314974f9-171b-4d59-8c17-aeb0d3370939 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:34.872356 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-b02b08ad-437f-447c-a7b9-a9cd70ee3ad5 req-314974f9-171b-4d59-8c17-aeb0d3370939 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:34.889901 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-b02b08ad-437f-447c-a7b9-a9cd70ee3ad5 req-314974f9-171b-4d59-8c17-aeb0d3370939 service nova] Creating event network-changed:6848a700-8424-47d3-8492-918f43aa51ad for instance 1797716b-0533-42be-8c06-750959aaf935 on hv-cinder-82002 Aug 11 11:04:34.897650 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-b02b08ad-437f-447c-a7b9-a9cd70ee3ad5 req-314974f9-171b-4d59-8c17-aeb0d3370939 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042646 Aug 11 11:04:34.898505 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 79/151] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:04:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 11:04:35.187351 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-4dc13896-1656-4624-86b3-636ae0ffe732 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:35.187977 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-4dc13896-1656-4624-86b3-636ae0ffe732 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:35.193882 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4dc13896-1656-4624-86b3-636ae0ffe732 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:35.194367 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4dc13896-1656-4624-86b3-636ae0ffe732 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:35.194798 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4dc13896-1656-4624-86b3-636ae0ffe732 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:35.195484 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4dc13896-1656-4624-86b3-636ae0ffe732 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:35.195964 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4dc13896-1656-4624-86b3-636ae0ffe732 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:35.196786 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4dc13896-1656-4624-86b3-636ae0ffe732 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:35.392723 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-4dc13896-1656-4624-86b3-636ae0ffe732 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:35.402615 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-4dc13896-1656-4624-86b3-636ae0ffe732 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:35.403779 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-b824c6e4-4aa2-432f-af83-984f67b02290 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:35.404480 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-b824c6e4-4aa2-432f-af83-984f67b02290 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: a09cb964-88a4-4fad-ae60-efb0a7a7dec2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:35.405403 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-4dc13896-1656-4624-86b3-636ae0ffe732 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:35.406752 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-4dc13896-1656-4624-86b3-636ae0ffe732 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1596 microversion: 2.20 time: 0.223707 Aug 11 11:04:35.414625 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b824c6e4-4aa2-432f-af83-984f67b02290 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:35.418055 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b824c6e4-4aa2-432f-af83-984f67b02290 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:35.418841 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b824c6e4-4aa2-432f-af83-984f67b02290 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:35.420205 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b824c6e4-4aa2-432f-af83-984f67b02290 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:35.420358 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 73/152] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:04:35 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1596 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:04:35.423073 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b824c6e4-4aa2-432f-af83-984f67b02290 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:35.424263 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b824c6e4-4aa2-432f-af83-984f67b02290 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:35.436239 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-1e6fbb5e-5dea-484f-908e-7f49f2e772dc tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:35.439527 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-1e6fbb5e-5dea-484f-908e-7f49f2e772dc tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:35.454560 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1e6fbb5e-5dea-484f-908e-7f49f2e772dc tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:35.464082 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1e6fbb5e-5dea-484f-908e-7f49f2e772dc tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:35.464082 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1e6fbb5e-5dea-484f-908e-7f49f2e772dc tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:35.464082 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1e6fbb5e-5dea-484f-908e-7f49f2e772dc tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:35.464082 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1e6fbb5e-5dea-484f-908e-7f49f2e772dc tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:35.464537 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1e6fbb5e-5dea-484f-908e-7f49f2e772dc tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:35.727329 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-1e6fbb5e-5dea-484f-908e-7f49f2e772dc tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.300312 Aug 11 11:04:35.728650 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 74/153] 10.222.0.48 () {60 vars in 1316 bytes} [Thu Aug 11 11:04:35 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc/os-interface => generated 284 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 11:04:35.733386 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-5e679e90-668c-4ecb-8672-8c3230d27090 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:35.734183 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-5e679e90-668c-4ecb-8672-8c3230d27090 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] [instance: 89f57d2f-28f8-4ad2-8b20-e6533726993b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:35.742978 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5e679e90-668c-4ecb-8672-8c3230d27090 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:35.743746 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5e679e90-668c-4ecb-8672-8c3230d27090 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:35.746951 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5e679e90-668c-4ecb-8672-8c3230d27090 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:35.746951 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5e679e90-668c-4ecb-8672-8c3230d27090 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:35.746951 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5e679e90-668c-4ecb-8672-8c3230d27090 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:35.746951 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5e679e90-668c-4ecb-8672-8c3230d27090 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:35.947856 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-b824c6e4-4aa2-432f-af83-984f67b02290 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:35.956230 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-b824c6e4-4aa2-432f-af83-984f67b02290 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2" status: 200 len: 1514 microversion: 2.1 time: 0.558191 Aug 11 11:04:35.957917 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 80/154] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:35 2022] GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2 => generated 1514 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:04:35.988596 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-b5734f03-3070-4248-bcfb-d4ba0a139a1c tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:04:35.991309 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-b5734f03-3070-4248-bcfb-d4ba0a139a1c tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: a09cb964-88a4-4fad-ae60-efb0a7a7dec2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:36.000311 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b5734f03-3070-4248-bcfb-d4ba0a139a1c tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:36.000800 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b5734f03-3070-4248-bcfb-d4ba0a139a1c tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:36.014650 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b5734f03-3070-4248-bcfb-d4ba0a139a1c tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:36.016366 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b5734f03-3070-4248-bcfb-d4ba0a139a1c tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:36.018524 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b5734f03-3070-4248-bcfb-d4ba0a139a1c tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:36.018983 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b5734f03-3070-4248-bcfb-d4ba0a139a1c tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:36.074011 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-5e679e90-668c-4ecb-8672-8c3230d27090 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6fc583bb8a4434b0c6538c9ffbde75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb076c769694966bbfea2f23ea8b8a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:36.097904 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-5e679e90-668c-4ecb-8672-8c3230d27090 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] 10.222.0.48 "GET /compute/v2.1/servers/89f57d2f-28f8-4ad2-8b20-e6533726993b" status: 200 len: 1314 microversion: 2.1 time: 0.367966 Aug 11 11:04:36.101019 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 75/155] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:35 2022] GET /compute/v2.1/servers/89f57d2f-28f8-4ad2-8b20-e6533726993b => generated 1314 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:04:36.118815 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.objects.instance [None req-b5734f03-3070-4248-bcfb-d4ba0a139a1c tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lazy-loading 'flavor' on Instance uuid a09cb964-88a4-4fad-ae60-efb0a7a7dec2 {{(pid=121232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 11:04:36.258603 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:04:36.746723 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-b5734f03-3070-4248-bcfb-d4ba0a139a1c tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "POST /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2/action" status: 200 len: 32 microversion: 2.1 time: 0.769955 Aug 11 11:04:36.752602 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 81/156] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Aug 11 11:04:35 2022] POST /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2/action => generated 32 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 11 11:04:36.760514 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-e8aee020-803e-43f4-bc65-263c0bb262e9 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:36.761278 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-e8aee020-803e-43f4-bc65-263c0bb262e9 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: a09cb964-88a4-4fad-ae60-efb0a7a7dec2] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:36.776777 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e8aee020-803e-43f4-bc65-263c0bb262e9 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:36.777569 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e8aee020-803e-43f4-bc65-263c0bb262e9 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:36.778118 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e8aee020-803e-43f4-bc65-263c0bb262e9 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:36.778986 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e8aee020-803e-43f4-bc65-263c0bb262e9 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:36.779675 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e8aee020-803e-43f4-bc65-263c0bb262e9 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:36.780171 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e8aee020-803e-43f4-bc65-263c0bb262e9 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:37.090068 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-e8aee020-803e-43f4-bc65-263c0bb262e9 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:37.104883 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-e8aee020-803e-43f4-bc65-263c0bb262e9 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2" status: 200 len: 1520 microversion: 2.1 time: 0.350505 Aug 11 11:04:37.105925 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 76/157] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:36 2022] GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2 => generated 1520 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:04:37.136166 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-f74ff1b9-5084-4b02-8f50-239504ea6343 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:37.136927 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-f74ff1b9-5084-4b02-8f50-239504ea6343 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] [instance: 89f57d2f-28f8-4ad2-8b20-e6533726993b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:37.148485 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f74ff1b9-5084-4b02-8f50-239504ea6343 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:37.148991 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f74ff1b9-5084-4b02-8f50-239504ea6343 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:37.150194 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f74ff1b9-5084-4b02-8f50-239504ea6343 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:37.151539 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f74ff1b9-5084-4b02-8f50-239504ea6343 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:37.152031 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f74ff1b9-5084-4b02-8f50-239504ea6343 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:37.152715 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f74ff1b9-5084-4b02-8f50-239504ea6343 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:37.538158 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-f74ff1b9-5084-4b02-8f50-239504ea6343 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6fc583bb8a4434b0c6538c9ffbde75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb076c769694966bbfea2f23ea8b8a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:37.546367 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-f74ff1b9-5084-4b02-8f50-239504ea6343 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] 10.222.0.48 "GET /compute/v2.1/servers/89f57d2f-28f8-4ad2-8b20-e6533726993b" status: 200 len: 1502 microversion: 2.1 time: 0.425058 Aug 11 11:04:37.559979 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 82/158] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:37 2022] GET /compute/v2.1/servers/89f57d2f-28f8-4ad2-8b20-e6533726993b => generated 1502 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:04:37.830463 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-a59ee770-3522-437c-a94c-04557e74054b req-89d93684-feaa-4cab-8fae-cdda778324ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82a61cf6-1f3f-4ced-9806-a06252b9b2cc", "tag": "71bca2c4-19df-4dc2-ad61-c7058687c043"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:04:37.840257 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-a59ee770-3522-437c-a94c-04557e74054b req-89d93684-feaa-4cab-8fae-cdda778324ff service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:37.840970 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-a59ee770-3522-437c-a94c-04557e74054b req-89d93684-feaa-4cab-8fae-cdda778324ff service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:37.841550 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-a59ee770-3522-437c-a94c-04557e74054b req-89d93684-feaa-4cab-8fae-cdda778324ff service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:37.853607 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-a59ee770-3522-437c-a94c-04557e74054b req-89d93684-feaa-4cab-8fae-cdda778324ff service nova] Creating event network-changed:71bca2c4-19df-4dc2-ad61-c7058687c043 for instance 82a61cf6-1f3f-4ced-9806-a06252b9b2cc on hv-cinder-82002 Aug 11 11:04:37.858860 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-a59ee770-3522-437c-a94c-04557e74054b req-89d93684-feaa-4cab-8fae-cdda778324ff service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031999 Aug 11 11:04:37.859594 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 77/159] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:04:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:04:38.131919 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-5755185a-88dc-4f9f-a7fb-a4e11a88676b tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:38.132716 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-5755185a-88dc-4f9f-a7fb-a4e11a88676b tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: a09cb964-88a4-4fad-ae60-efb0a7a7dec2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:38.141718 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5755185a-88dc-4f9f-a7fb-a4e11a88676b tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:38.144192 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5755185a-88dc-4f9f-a7fb-a4e11a88676b tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:38.145224 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5755185a-88dc-4f9f-a7fb-a4e11a88676b tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:38.146752 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5755185a-88dc-4f9f-a7fb-a4e11a88676b tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:38.147578 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5755185a-88dc-4f9f-a7fb-a4e11a88676b tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:38.148457 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5755185a-88dc-4f9f-a7fb-a4e11a88676b tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:38.316684 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-5755185a-88dc-4f9f-a7fb-a4e11a88676b tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:38.330103 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-5755185a-88dc-4f9f-a7fb-a4e11a88676b tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2" status: 200 len: 1520 microversion: 2.1 time: 0.200305 Aug 11 11:04:38.346778 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 83/160] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:38 2022] GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2 => generated 1520 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:04:39.382163 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-c51de9b5-6d8c-4830-9001-93b6d543fcaf tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:39.384427 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-c51de9b5-6d8c-4830-9001-93b6d543fcaf tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: a09cb964-88a4-4fad-ae60-efb0a7a7dec2] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:39.398331 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c51de9b5-6d8c-4830-9001-93b6d543fcaf tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:39.401142 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c51de9b5-6d8c-4830-9001-93b6d543fcaf tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:39.402008 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c51de9b5-6d8c-4830-9001-93b6d543fcaf tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:39.404502 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c51de9b5-6d8c-4830-9001-93b6d543fcaf tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:39.405159 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c51de9b5-6d8c-4830-9001-93b6d543fcaf tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:39.405602 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c51de9b5-6d8c-4830-9001-93b6d543fcaf tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:39.412173 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell1:SELECT=100 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:04:39.675249 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-c51de9b5-6d8c-4830-9001-93b6d543fcaf tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:39.683699 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-c51de9b5-6d8c-4830-9001-93b6d543fcaf tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2" status: 200 len: 1520 microversion: 2.1 time: 0.330659 Aug 11 11:04:39.684283 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 78/161] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:39 2022] GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2 => generated 1520 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:04:40.704409 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-82b44677-6bff-4867-8cc9-6bce1c3ca604 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:40.705084 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-82b44677-6bff-4867-8cc9-6bce1c3ca604 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: a09cb964-88a4-4fad-ae60-efb0a7a7dec2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:40.708132 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_api:SELECT=93 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:04:40.712252 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-8ba2aca8-1296-40f6-bc63-cd6392248dee tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "02049bf7-dc48-4c09-8fb8-2ad625ae5527"}} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:04:40.713276 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-82b44677-6bff-4867-8cc9-6bce1c3ca604 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:40.713749 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-82b44677-6bff-4867-8cc9-6bce1c3ca604 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:40.714181 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-82b44677-6bff-4867-8cc9-6bce1c3ca604 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:40.714700 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-8ba2aca8-1296-40f6-bc63-cd6392248dee tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] [instance: 89f57d2f-28f8-4ad2-8b20-e6533726993b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:40.714888 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-82b44677-6bff-4867-8cc9-6bce1c3ca604 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:40.715322 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-82b44677-6bff-4867-8cc9-6bce1c3ca604 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:40.715800 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-82b44677-6bff-4867-8cc9-6bce1c3ca604 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:40.721311 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8ba2aca8-1296-40f6-bc63-cd6392248dee tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:40.721801 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8ba2aca8-1296-40f6-bc63-cd6392248dee tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:40.722236 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8ba2aca8-1296-40f6-bc63-cd6392248dee tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:40.722929 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8ba2aca8-1296-40f6-bc63-cd6392248dee tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:40.723415 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8ba2aca8-1296-40f6-bc63-cd6392248dee tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:40.723865 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8ba2aca8-1296-40f6-bc63-cd6392248dee tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:40.893116 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-82b44677-6bff-4867-8cc9-6bce1c3ca604 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:40.901601 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-82b44677-6bff-4867-8cc9-6bce1c3ca604 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2" status: 200 len: 1520 microversion: 2.1 time: 0.201005 Aug 11 11:04:40.902174 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 84/162] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:40 2022] GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2 => generated 1520 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:04:41.892093 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-8ba2aca8-1296-40f6-bc63-cd6392248dee tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] 10.222.0.48 "POST /compute/v2.1/servers/89f57d2f-28f8-4ad2-8b20-e6533726993b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.183692 Aug 11 11:04:41.892919 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 79/163] 10.222.0.48 () {60 vars in 1323 bytes} [Thu Aug 11 11:04:40 2022] POST /compute/v2.1/servers/89f57d2f-28f8-4ad2-8b20-e6533726993b/os-volume_attachments => generated 194 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 11:04:41.923343 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-5bb3c815-62e2-4ae1-9a48-8a13542ab74e tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:41.924581 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-5bb3c815-62e2-4ae1-9a48-8a13542ab74e tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: a09cb964-88a4-4fad-ae60-efb0a7a7dec2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:41.930638 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5bb3c815-62e2-4ae1-9a48-8a13542ab74e tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:41.931120 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5bb3c815-62e2-4ae1-9a48-8a13542ab74e tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:41.931626 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5bb3c815-62e2-4ae1-9a48-8a13542ab74e tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:41.932370 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5bb3c815-62e2-4ae1-9a48-8a13542ab74e tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:41.932831 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5bb3c815-62e2-4ae1-9a48-8a13542ab74e tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:41.933512 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5bb3c815-62e2-4ae1-9a48-8a13542ab74e tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:42.068938 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-5bb3c815-62e2-4ae1-9a48-8a13542ab74e tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:42.081065 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-5bb3c815-62e2-4ae1-9a48-8a13542ab74e tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2" status: 200 len: 1520 microversion: 2.1 time: 0.161858 Aug 11 11:04:42.083022 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 85/164] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:41 2022] GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:04:43.105500 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-ade96f73-de38-4051-805d-9621b9424ad8 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:43.106214 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-ade96f73-de38-4051-805d-9621b9424ad8 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: a09cb964-88a4-4fad-ae60-efb0a7a7dec2] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:43.112474 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ade96f73-de38-4051-805d-9621b9424ad8 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:43.112939 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ade96f73-de38-4051-805d-9621b9424ad8 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:43.113366 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ade96f73-de38-4051-805d-9621b9424ad8 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:43.114034 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ade96f73-de38-4051-805d-9621b9424ad8 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:43.114476 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ade96f73-de38-4051-805d-9621b9424ad8 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:43.114890 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ade96f73-de38-4051-805d-9621b9424ad8 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:43.255421 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-ade96f73-de38-4051-805d-9621b9424ad8 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:43.262980 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-ade96f73-de38-4051-805d-9621b9424ad8 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2" status: 200 len: 1520 microversion: 2.1 time: 0.162129 Aug 11 11:04:43.263539 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 80/165] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:43 2022] GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:04:44.286331 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-91104790-b103-4267-a1e7-0a688ae02db1 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:44.286931 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-91104790-b103-4267-a1e7-0a688ae02db1 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: a09cb964-88a4-4fad-ae60-efb0a7a7dec2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:44.293250 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-91104790-b103-4267-a1e7-0a688ae02db1 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:44.293914 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-91104790-b103-4267-a1e7-0a688ae02db1 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:44.294344 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-91104790-b103-4267-a1e7-0a688ae02db1 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:44.295034 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-91104790-b103-4267-a1e7-0a688ae02db1 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:44.295605 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-91104790-b103-4267-a1e7-0a688ae02db1 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:44.296221 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-91104790-b103-4267-a1e7-0a688ae02db1 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:44.465285 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-91104790-b103-4267-a1e7-0a688ae02db1 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:44.478431 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-91104790-b103-4267-a1e7-0a688ae02db1 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2" status: 200 len: 1520 microversion: 2.1 time: 0.196363 Aug 11 11:04:44.483800 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 86/166] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:44 2022] GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2 => generated 1520 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:04:45.500087 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-4f1ff9c8-326c-40d8-8844-76ba57c843b5 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:45.501525 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-4f1ff9c8-326c-40d8-8844-76ba57c843b5 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: a09cb964-88a4-4fad-ae60-efb0a7a7dec2] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:45.510597 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4f1ff9c8-326c-40d8-8844-76ba57c843b5 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:45.511090 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4f1ff9c8-326c-40d8-8844-76ba57c843b5 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:45.511527 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4f1ff9c8-326c-40d8-8844-76ba57c843b5 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:45.512460 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4f1ff9c8-326c-40d8-8844-76ba57c843b5 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:45.513136 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4f1ff9c8-326c-40d8-8844-76ba57c843b5 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:45.513349 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4f1ff9c8-326c-40d8-8844-76ba57c843b5 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:45.678830 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-4f1ff9c8-326c-40d8-8844-76ba57c843b5 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:45.688602 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-4f1ff9c8-326c-40d8-8844-76ba57c843b5 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2" status: 200 len: 1520 microversion: 2.1 time: 0.193208 Aug 11 11:04:45.689181 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 81/167] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:45 2022] GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2 => generated 1520 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:04:46.718385 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-893ca96d-8b41-47d3-8f42-bfc4345ff8d4 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:46.719615 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-893ca96d-8b41-47d3-8f42-bfc4345ff8d4 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: a09cb964-88a4-4fad-ae60-efb0a7a7dec2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:46.728329 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-893ca96d-8b41-47d3-8f42-bfc4345ff8d4 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:46.735956 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-893ca96d-8b41-47d3-8f42-bfc4345ff8d4 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:46.735956 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-893ca96d-8b41-47d3-8f42-bfc4345ff8d4 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:46.735956 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-893ca96d-8b41-47d3-8f42-bfc4345ff8d4 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:46.735956 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-893ca96d-8b41-47d3-8f42-bfc4345ff8d4 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:46.736747 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-893ca96d-8b41-47d3-8f42-bfc4345ff8d4 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:47.004510 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-893ca96d-8b41-47d3-8f42-bfc4345ff8d4 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:47.015065 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-893ca96d-8b41-47d3-8f42-bfc4345ff8d4 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2" status: 200 len: 1520 microversion: 2.1 time: 0.300096 Aug 11 11:04:47.026997 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 87/168] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:46 2022] GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2 => generated 1520 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:04:48.034546 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-e7e09701-01b9-4a6d-95fe-f5aa4bd9d7a4 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:48.035245 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-e7e09701-01b9-4a6d-95fe-f5aa4bd9d7a4 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: a09cb964-88a4-4fad-ae60-efb0a7a7dec2] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:48.042633 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e7e09701-01b9-4a6d-95fe-f5aa4bd9d7a4 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:48.043192 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e7e09701-01b9-4a6d-95fe-f5aa4bd9d7a4 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:48.043701 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e7e09701-01b9-4a6d-95fe-f5aa4bd9d7a4 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:48.044478 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e7e09701-01b9-4a6d-95fe-f5aa4bd9d7a4 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:48.044923 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e7e09701-01b9-4a6d-95fe-f5aa4bd9d7a4 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:48.049890 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e7e09701-01b9-4a6d-95fe-f5aa4bd9d7a4 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:48.173481 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-e7e09701-01b9-4a6d-95fe-f5aa4bd9d7a4 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:48.180929 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-e7e09701-01b9-4a6d-95fe-f5aa4bd9d7a4 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2" status: 200 len: 1520 microversion: 2.1 time: 0.150316 Aug 11 11:04:48.181799 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 82/169] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:48 2022] GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:04:49.202093 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-e0caaea9-efeb-4a00-b0a2-6a8d156cf71f tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:49.202686 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-e0caaea9-efeb-4a00-b0a2-6a8d156cf71f tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: a09cb964-88a4-4fad-ae60-efb0a7a7dec2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:49.208744 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e0caaea9-efeb-4a00-b0a2-6a8d156cf71f tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:49.209221 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e0caaea9-efeb-4a00-b0a2-6a8d156cf71f tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:49.209643 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e0caaea9-efeb-4a00-b0a2-6a8d156cf71f tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:49.210319 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e0caaea9-efeb-4a00-b0a2-6a8d156cf71f tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:49.210910 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e0caaea9-efeb-4a00-b0a2-6a8d156cf71f tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:49.212452 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e0caaea9-efeb-4a00-b0a2-6a8d156cf71f tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:49.345375 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-e0caaea9-efeb-4a00-b0a2-6a8d156cf71f tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:49.352835 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-e0caaea9-efeb-4a00-b0a2-6a8d156cf71f tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2" status: 200 len: 1520 microversion: 2.1 time: 0.154695 Aug 11 11:04:49.353395 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 88/170] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:49 2022] GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:04:50.373156 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-5f286bf6-d95e-446c-8ac5-f18c42429491 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:50.373791 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-5f286bf6-d95e-446c-8ac5-f18c42429491 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: a09cb964-88a4-4fad-ae60-efb0a7a7dec2] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:50.376284 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_api:SELECT=80 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:04:50.380981 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5f286bf6-d95e-446c-8ac5-f18c42429491 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:50.382351 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5f286bf6-d95e-446c-8ac5-f18c42429491 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:50.382351 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5f286bf6-d95e-446c-8ac5-f18c42429491 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:50.382690 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5f286bf6-d95e-446c-8ac5-f18c42429491 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:50.383147 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5f286bf6-d95e-446c-8ac5-f18c42429491 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:50.383568 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5f286bf6-d95e-446c-8ac5-f18c42429491 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:50.510701 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-5f286bf6-d95e-446c-8ac5-f18c42429491 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:50.518156 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-5f286bf6-d95e-446c-8ac5-f18c42429491 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2" status: 200 len: 1520 microversion: 2.1 time: 0.148868 Aug 11 11:04:50.518713 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 83/171] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:50 2022] GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:04:51.538318 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-b62989e7-a2e6-4a3c-b71e-27e26204a97f tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:51.538921 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-b62989e7-a2e6-4a3c-b71e-27e26204a97f tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: a09cb964-88a4-4fad-ae60-efb0a7a7dec2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:51.545799 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b62989e7-a2e6-4a3c-b71e-27e26204a97f tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:51.546459 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b62989e7-a2e6-4a3c-b71e-27e26204a97f tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:51.547082 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b62989e7-a2e6-4a3c-b71e-27e26204a97f tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:51.548069 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b62989e7-a2e6-4a3c-b71e-27e26204a97f tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:51.548394 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b62989e7-a2e6-4a3c-b71e-27e26204a97f tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:51.548825 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b62989e7-a2e6-4a3c-b71e-27e26204a97f tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:51.683014 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-b62989e7-a2e6-4a3c-b71e-27e26204a97f tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:51.690983 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-b62989e7-a2e6-4a3c-b71e-27e26204a97f tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2" status: 200 len: 1520 microversion: 2.1 time: 0.156602 Aug 11 11:04:51.691552 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 89/172] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:51 2022] GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:04:52.712267 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-570aecce-cc58-46ae-a887-d715de4d38ed tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:52.712865 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-570aecce-cc58-46ae-a887-d715de4d38ed tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: a09cb964-88a4-4fad-ae60-efb0a7a7dec2] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:52.720731 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-570aecce-cc58-46ae-a887-d715de4d38ed tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:52.721283 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-570aecce-cc58-46ae-a887-d715de4d38ed tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:52.721722 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-570aecce-cc58-46ae-a887-d715de4d38ed tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:52.722417 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-570aecce-cc58-46ae-a887-d715de4d38ed tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:52.723027 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-570aecce-cc58-46ae-a887-d715de4d38ed tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:52.723608 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-570aecce-cc58-46ae-a887-d715de4d38ed tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:52.869646 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-570aecce-cc58-46ae-a887-d715de4d38ed tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:52.877394 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-570aecce-cc58-46ae-a887-d715de4d38ed tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2" status: 200 len: 1520 microversion: 2.1 time: 0.169485 Aug 11 11:04:52.878386 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 84/173] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:52 2022] GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:04:53.903555 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-bca96794-3d69-4441-a69c-7dbfa0aa6b97 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:53.904610 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-bca96794-3d69-4441-a69c-7dbfa0aa6b97 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: a09cb964-88a4-4fad-ae60-efb0a7a7dec2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:53.911078 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bca96794-3d69-4441-a69c-7dbfa0aa6b97 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:53.911637 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bca96794-3d69-4441-a69c-7dbfa0aa6b97 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:53.912335 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bca96794-3d69-4441-a69c-7dbfa0aa6b97 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:53.913259 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bca96794-3d69-4441-a69c-7dbfa0aa6b97 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:53.913768 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bca96794-3d69-4441-a69c-7dbfa0aa6b97 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:53.914775 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bca96794-3d69-4441-a69c-7dbfa0aa6b97 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:54.104000 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-bca96794-3d69-4441-a69c-7dbfa0aa6b97 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:54.111848 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-bca96794-3d69-4441-a69c-7dbfa0aa6b97 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2" status: 200 len: 1520 microversion: 2.1 time: 0.215344 Aug 11 11:04:54.112683 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 90/174] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:53 2022] GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2 => generated 1520 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:04:54.288672 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-7c70c3b3-a7ff-4831-af4d-4fb7ae7c65dd tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:54.289770 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-7c70c3b3-a7ff-4831-af4d-4fb7ae7c65dd tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] [instance: 89f57d2f-28f8-4ad2-8b20-e6533726993b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:54.296526 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7c70c3b3-a7ff-4831-af4d-4fb7ae7c65dd tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:54.296997 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7c70c3b3-a7ff-4831-af4d-4fb7ae7c65dd tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:54.297424 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7c70c3b3-a7ff-4831-af4d-4fb7ae7c65dd tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:54.298111 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7c70c3b3-a7ff-4831-af4d-4fb7ae7c65dd tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:54.298569 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7c70c3b3-a7ff-4831-af4d-4fb7ae7c65dd tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:54.298991 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7c70c3b3-a7ff-4831-af4d-4fb7ae7c65dd tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:54.323971 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-7c70c3b3-a7ff-4831-af4d-4fb7ae7c65dd tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] [instance: 89f57d2f-28f8-4ad2-8b20-e6533726993b] Going to try to terminate instance {{(pid=121231) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 11 11:04:54.720179 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-7c70c3b3-a7ff-4831-af4d-4fb7ae7c65dd tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] 10.222.0.48 "DELETE /compute/v2.1/servers/89f57d2f-28f8-4ad2-8b20-e6533726993b" status: 204 len: 0 microversion: 2.1 time: 0.435188 Aug 11 11:04:54.720784 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 85/175] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Aug 11 11:04:54 2022] DELETE /compute/v2.1/servers/89f57d2f-28f8-4ad2-8b20-e6533726993b => generated 0 bytes in 437 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 11 11:04:54.729214 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-47abc973-98d9-427f-aac4-8e45eca86e6e tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:54.729817 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-47abc973-98d9-427f-aac4-8e45eca86e6e tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] [instance: 89f57d2f-28f8-4ad2-8b20-e6533726993b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:54.737153 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-47abc973-98d9-427f-aac4-8e45eca86e6e tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:54.737627 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-47abc973-98d9-427f-aac4-8e45eca86e6e tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:54.738053 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-47abc973-98d9-427f-aac4-8e45eca86e6e tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:54.738759 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-47abc973-98d9-427f-aac4-8e45eca86e6e tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:54.739206 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-47abc973-98d9-427f-aac4-8e45eca86e6e tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:54.739622 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-47abc973-98d9-427f-aac4-8e45eca86e6e tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:54.874269 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-47abc973-98d9-427f-aac4-8e45eca86e6e tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6fc583bb8a4434b0c6538c9ffbde75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb076c769694966bbfea2f23ea8b8a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:54.887694 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-47abc973-98d9-427f-aac4-8e45eca86e6e tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] 10.222.0.48 "GET /compute/v2.1/servers/89f57d2f-28f8-4ad2-8b20-e6533726993b" status: 200 len: 1554 microversion: 2.1 time: 0.162244 Aug 11 11:04:54.888294 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 91/176] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:54 2022] GET /compute/v2.1/servers/89f57d2f-28f8-4ad2-8b20-e6533726993b => generated 1554 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:04:55.133647 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-f78d69bd-5a55-442f-85ff-b9d774237fea tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:55.134255 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-f78d69bd-5a55-442f-85ff-b9d774237fea tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: a09cb964-88a4-4fad-ae60-efb0a7a7dec2] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:55.140883 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f78d69bd-5a55-442f-85ff-b9d774237fea tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:55.141362 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f78d69bd-5a55-442f-85ff-b9d774237fea tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:55.141774 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f78d69bd-5a55-442f-85ff-b9d774237fea tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:55.142447 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f78d69bd-5a55-442f-85ff-b9d774237fea tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:55.142904 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f78d69bd-5a55-442f-85ff-b9d774237fea tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:55.143320 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f78d69bd-5a55-442f-85ff-b9d774237fea tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:55.280740 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-f78d69bd-5a55-442f-85ff-b9d774237fea tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:55.290099 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-f78d69bd-5a55-442f-85ff-b9d774237fea tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2" status: 200 len: 1520 microversion: 2.1 time: 0.160584 Aug 11 11:04:55.290963 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 86/177] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:55 2022] GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:04:55.914451 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-d05fcc6f-53be-4a8d-a0ce-033f01ca92bd tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:55.915060 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-d05fcc6f-53be-4a8d-a0ce-033f01ca92bd tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] [instance: 89f57d2f-28f8-4ad2-8b20-e6533726993b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:55.935890 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d05fcc6f-53be-4a8d-a0ce-033f01ca92bd tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:55.936536 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d05fcc6f-53be-4a8d-a0ce-033f01ca92bd tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:55.937137 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d05fcc6f-53be-4a8d-a0ce-033f01ca92bd tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:55.937850 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d05fcc6f-53be-4a8d-a0ce-033f01ca92bd tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:55.938313 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d05fcc6f-53be-4a8d-a0ce-033f01ca92bd tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:55.938771 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d05fcc6f-53be-4a8d-a0ce-033f01ca92bd tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:56.108494 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d05fcc6f-53be-4a8d-a0ce-033f01ca92bd tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6fc583bb8a4434b0c6538c9ffbde75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb076c769694966bbfea2f23ea8b8a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:56.119236 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-d05fcc6f-53be-4a8d-a0ce-033f01ca92bd tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] 10.222.0.48 "GET /compute/v2.1/servers/89f57d2f-28f8-4ad2-8b20-e6533726993b" status: 200 len: 1554 microversion: 2.1 time: 0.208584 Aug 11 11:04:56.119583 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 92/178] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:55 2022] GET /compute/v2.1/servers/89f57d2f-28f8-4ad2-8b20-e6533726993b => generated 1554 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:04:56.322537 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-d657b98f-bba8-4aa6-8c4d-0aa06ace4bff tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:56.327606 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-d657b98f-bba8-4aa6-8c4d-0aa06ace4bff tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: a09cb964-88a4-4fad-ae60-efb0a7a7dec2] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:56.342485 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d657b98f-bba8-4aa6-8c4d-0aa06ace4bff tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:56.342992 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d657b98f-bba8-4aa6-8c4d-0aa06ace4bff tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:56.343426 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d657b98f-bba8-4aa6-8c4d-0aa06ace4bff tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:56.344184 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d657b98f-bba8-4aa6-8c4d-0aa06ace4bff tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:56.344642 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d657b98f-bba8-4aa6-8c4d-0aa06ace4bff tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:56.345065 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d657b98f-bba8-4aa6-8c4d-0aa06ace4bff tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:56.536911 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-d657b98f-bba8-4aa6-8c4d-0aa06ace4bff tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:56.544652 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-d657b98f-bba8-4aa6-8c4d-0aa06ace4bff tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2" status: 200 len: 1520 microversion: 2.1 time: 0.229753 Aug 11 11:04:56.545232 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 87/179] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:56 2022] GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2 => generated 1520 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:04:57.147640 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-29f8ef86-1d42-4420-90d5-ca53d6e8dd9e tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:57.148787 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-29f8ef86-1d42-4420-90d5-ca53d6e8dd9e tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] [instance: 89f57d2f-28f8-4ad2-8b20-e6533726993b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:57.154647 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-29f8ef86-1d42-4420-90d5-ca53d6e8dd9e tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:57.155129 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-29f8ef86-1d42-4420-90d5-ca53d6e8dd9e tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:57.155562 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-29f8ef86-1d42-4420-90d5-ca53d6e8dd9e tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:57.156270 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-29f8ef86-1d42-4420-90d5-ca53d6e8dd9e tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:57.156720 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-29f8ef86-1d42-4420-90d5-ca53d6e8dd9e tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:57.157139 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-29f8ef86-1d42-4420-90d5-ca53d6e8dd9e tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:57.290187 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-29f8ef86-1d42-4420-90d5-ca53d6e8dd9e tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6fc583bb8a4434b0c6538c9ffbde75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb076c769694966bbfea2f23ea8b8a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:57.298184 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-29f8ef86-1d42-4420-90d5-ca53d6e8dd9e tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] 10.222.0.48 "GET /compute/v2.1/servers/89f57d2f-28f8-4ad2-8b20-e6533726993b" status: 200 len: 1554 microversion: 2.1 time: 0.154554 Aug 11 11:04:57.298837 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 93/180] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:57 2022] GET /compute/v2.1/servers/89f57d2f-28f8-4ad2-8b20-e6533726993b => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:04:57.574825 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-7f77b994-807e-4d12-b147-5dfc8f514229 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:57.575317 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-7f77b994-807e-4d12-b147-5dfc8f514229 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: a09cb964-88a4-4fad-ae60-efb0a7a7dec2] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:57.590190 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7f77b994-807e-4d12-b147-5dfc8f514229 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:57.590668 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7f77b994-807e-4d12-b147-5dfc8f514229 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:57.591104 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7f77b994-807e-4d12-b147-5dfc8f514229 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:57.595254 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7f77b994-807e-4d12-b147-5dfc8f514229 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:57.595910 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7f77b994-807e-4d12-b147-5dfc8f514229 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:57.596193 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7f77b994-807e-4d12-b147-5dfc8f514229 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:58.079587 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-7f77b994-807e-4d12-b147-5dfc8f514229 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:58.089646 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-7f77b994-807e-4d12-b147-5dfc8f514229 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2" status: 200 len: 1520 microversion: 2.1 time: 0.520570 Aug 11 11:04:58.090991 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 88/181] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:57 2022] GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2 => generated 1520 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:04:58.321577 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-9143ced7-59ab-4aaf-97a3-45b90e5e8e86 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:58.322197 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-9143ced7-59ab-4aaf-97a3-45b90e5e8e86 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] [instance: 89f57d2f-28f8-4ad2-8b20-e6533726993b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:58.328352 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9143ced7-59ab-4aaf-97a3-45b90e5e8e86 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:58.329067 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9143ced7-59ab-4aaf-97a3-45b90e5e8e86 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:58.329501 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9143ced7-59ab-4aaf-97a3-45b90e5e8e86 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:58.330350 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9143ced7-59ab-4aaf-97a3-45b90e5e8e86 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:58.331007 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9143ced7-59ab-4aaf-97a3-45b90e5e8e86 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:58.331625 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9143ced7-59ab-4aaf-97a3-45b90e5e8e86 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:58.434725 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-9143ced7-59ab-4aaf-97a3-45b90e5e8e86 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6fc583bb8a4434b0c6538c9ffbde75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb076c769694966bbfea2f23ea8b8a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:58.448307 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-408c2489-36f4-4979-bdef-92a3c511825e req-7f2437de-b66d-4915-a4e1-068c7251d92f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89f57d2f-28f8-4ad2-8b20-e6533726993b", "name": "network-vif-deleted", "tag": "88fbb9e2-cef3-480b-b104-e4319e0404cb"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:04:58.448535 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-9143ced7-59ab-4aaf-97a3-45b90e5e8e86 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] 10.222.0.48 "GET /compute/v2.1/servers/89f57d2f-28f8-4ad2-8b20-e6533726993b" status: 200 len: 1512 microversion: 2.1 time: 0.131137 Aug 11 11:04:58.452255 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 94/182] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:58 2022] GET /compute/v2.1/servers/89f57d2f-28f8-4ad2-8b20-e6533726993b => generated 1512 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:04:58.464198 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-408c2489-36f4-4979-bdef-92a3c511825e req-7f2437de-b66d-4915-a4e1-068c7251d92f service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:58.464840 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-408c2489-36f4-4979-bdef-92a3c511825e req-7f2437de-b66d-4915-a4e1-068c7251d92f service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:58.465150 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-408c2489-36f4-4979-bdef-92a3c511825e req-7f2437de-b66d-4915-a4e1-068c7251d92f service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:58.537256 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-408c2489-36f4-4979-bdef-92a3c511825e req-7f2437de-b66d-4915-a4e1-068c7251d92f service nova] Creating event network-vif-deleted:88fbb9e2-cef3-480b-b104-e4319e0404cb for instance 89f57d2f-28f8-4ad2-8b20-e6533726993b on hv-cinder-82002 Aug 11 11:04:58.547204 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-408c2489-36f4-4979-bdef-92a3c511825e req-7f2437de-b66d-4915-a4e1-068c7251d92f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103117 Aug 11 11:04:58.548165 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 89/183] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:04:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:04:59.111202 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-306e42cc-8d02-4eb1-a1b4-dd465faa9880 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:59.112626 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-306e42cc-8d02-4eb1-a1b4-dd465faa9880 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: a09cb964-88a4-4fad-ae60-efb0a7a7dec2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:59.122727 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-306e42cc-8d02-4eb1-a1b4-dd465faa9880 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:59.131129 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-306e42cc-8d02-4eb1-a1b4-dd465faa9880 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:59.131583 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-306e42cc-8d02-4eb1-a1b4-dd465faa9880 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:59.132345 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-306e42cc-8d02-4eb1-a1b4-dd465faa9880 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:59.132806 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-306e42cc-8d02-4eb1-a1b4-dd465faa9880 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:59.133233 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-306e42cc-8d02-4eb1-a1b4-dd465faa9880 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:59.266968 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-306e42cc-8d02-4eb1-a1b4-dd465faa9880 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:59.275059 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-306e42cc-8d02-4eb1-a1b4-dd465faa9880 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2" status: 200 len: 1520 microversion: 2.1 time: 0.168086 Aug 11 11:04:59.275627 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 95/184] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:59 2022] GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:04:59.479032 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-9be18eb9-f4e1-4d0b-83e6-7e70f037ac1f tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:04:59.479730 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-9be18eb9-f4e1-4d0b-83e6-7e70f037ac1f tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] [instance: 89f57d2f-28f8-4ad2-8b20-e6533726993b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:04:59.489053 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9be18eb9-f4e1-4d0b-83e6-7e70f037ac1f tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:59.490172 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9be18eb9-f4e1-4d0b-83e6-7e70f037ac1f tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:59.490638 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9be18eb9-f4e1-4d0b-83e6-7e70f037ac1f tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:59.492321 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9be18eb9-f4e1-4d0b-83e6-7e70f037ac1f tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:04:59.493199 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9be18eb9-f4e1-4d0b-83e6-7e70f037ac1f tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:04:59.496452 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9be18eb9-f4e1-4d0b-83e6-7e70f037ac1f tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:04:59.578722 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-9be18eb9-f4e1-4d0b-83e6-7e70f037ac1f tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d6fc583bb8a4434b0c6538c9ffbde75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbb076c769694966bbfea2f23ea8b8a4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:04:59.588685 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-9be18eb9-f4e1-4d0b-83e6-7e70f037ac1f tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] 10.222.0.48 "GET /compute/v2.1/servers/89f57d2f-28f8-4ad2-8b20-e6533726993b" status: 200 len: 1345 microversion: 2.1 time: 0.114462 Aug 11 11:04:59.589400 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 90/185] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:04:59 2022] GET /compute/v2.1/servers/89f57d2f-28f8-4ad2-8b20-e6533726993b => generated 1345 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:05:00.296386 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-78d8320e-775b-4b9d-ad91-e3b7c6e2f312 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:05:00.297086 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-78d8320e-775b-4b9d-ad91-e3b7c6e2f312 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: a09cb964-88a4-4fad-ae60-efb0a7a7dec2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:05:00.305347 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-78d8320e-775b-4b9d-ad91-e3b7c6e2f312 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:00.306062 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-78d8320e-775b-4b9d-ad91-e3b7c6e2f312 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:00.306498 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-78d8320e-775b-4b9d-ad91-e3b7c6e2f312 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:00.308277 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-78d8320e-775b-4b9d-ad91-e3b7c6e2f312 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:00.309143 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-78d8320e-775b-4b9d-ad91-e3b7c6e2f312 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:00.309582 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-78d8320e-775b-4b9d-ad91-e3b7c6e2f312 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:00.466693 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-78d8320e-775b-4b9d-ad91-e3b7c6e2f312 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:05:00.474548 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-78d8320e-775b-4b9d-ad91-e3b7c6e2f312 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2" status: 200 len: 1520 microversion: 2.1 time: 0.182729 Aug 11 11:05:00.475119 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 96/186] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:05:00 2022] GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2 => generated 1520 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:05:00.613212 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-ff8609c1-288b-4a4c-a5a3-e90201bd8853 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:05:00.616506 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-ff8609c1-288b-4a4c-a5a3-e90201bd8853 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] [instance: 89f57d2f-28f8-4ad2-8b20-e6533726993b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:05:00.625259 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ff8609c1-288b-4a4c-a5a3-e90201bd8853 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:00.625939 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ff8609c1-288b-4a4c-a5a3-e90201bd8853 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:00.626638 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ff8609c1-288b-4a4c-a5a3-e90201bd8853 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:00.627363 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ff8609c1-288b-4a4c-a5a3-e90201bd8853 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:00.627865 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ff8609c1-288b-4a4c-a5a3-e90201bd8853 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:00.628295 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ff8609c1-288b-4a4c-a5a3-e90201bd8853 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:00.643187 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.wsgi [None req-ff8609c1-288b-4a4c-a5a3-e90201bd8853 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] HTTP exception thrown: Instance 89f57d2f-28f8-4ad2-8b20-e6533726993b could not be found. Aug 11 11:05:00.647980 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-ff8609c1-288b-4a4c-a5a3-e90201bd8853 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Request method failure captured: Aug 11 11:05:00.647980 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: request: GET /compute/v2.1/servers/89f57d2f-28f8-4ad2-8b20-e6533726993b HTTP/1.1 Aug 11 11:05:00.647980 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Accept: application/json Aug 11 11:05:00.647980 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Accept-Encoding: identity Aug 11 11:05:00.647980 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Connection: close Aug 11 11:05:00.647980 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Content-Length: 0 Aug 11 11:05:00.647980 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Content-Type: application/json Aug 11 11:05:00.647980 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Host: 10.222.0.48 Aug 11 11:05:00.647980 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Openstack-System-Scope: None Aug 11 11:05:00.647980 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: User-Agent: python-urllib3/1.26.11 Aug 11 11:05:00.647980 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Auth-Token: gAAAAABi9OIX5xYECmejmoRvdO0tSj1pB9kIA0rioYjIgMmyiJxATTJ3UZXjCxbvnUx6TqO34mJEpAYd_n-veVlY83bzUJsMbHxbY_aEzFFNsy_Hf0EUUX1kVFhtCwizdlfRoVa04FXPCUKapd6ZZiwglE5a6YdesUJ89sL-DpiUeKlspl1TOos Aug 11 11:05:00.647980 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Domain-Id: None Aug 11 11:05:00.647980 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Domain-Name: None Aug 11 11:05:00.647980 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Identity-Status: Confirmed Aug 11 11:05:00.647980 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Is-Admin-Project: True Aug 11 11:05:00.647980 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Domain-Id: default Aug 11 11:05:00.647980 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Domain-Name: Default Aug 11 11:05:00.647980 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Id: cbb076c769694966bbfea2f23ea8b8a4 Aug 11 11:05:00.647980 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Name: tempest-DeleteServersTestJSON-867048334 Aug 11 11:05:00.647980 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Role: reader,member Aug 11 11:05:00.647980 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Roles: reader,member Aug 11 11:05:00.649451 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/cbb076c769694966bbfea2f23ea8b8a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/cbb076c769694966bbfea2f23ea8b8a4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/cbb076c769694966bbfea2f23ea8b8a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_cbb076c769694966bbfea2f23ea8b8a4", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] Aug 11 11:05:00.649451 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant: tempest-DeleteServersTestJSON-867048334 Aug 11 11:05:00.649451 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant-Id: cbb076c769694966bbfea2f23ea8b8a4 Aug 11 11:05:00.649451 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant-Name: tempest-DeleteServersTestJSON-867048334 Aug 11 11:05:00.649451 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User: tempest-DeleteServersTestJSON-867048334-project Aug 11 11:05:00.649451 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Domain-Id: default Aug 11 11:05:00.649451 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Domain-Name: Default Aug 11 11:05:00.649451 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Id: 2d6fc583bb8a4434b0c6538c9ffbde75 Aug 11 11:05:00.649451 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Name: tempest-DeleteServersTestJSON-867048334-project Aug 11 11:05:00.649451 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: method: > Aug 11 11:05:00.649451 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: exception: Instance 89f57d2f-28f8-4ad2-8b20-e6533726993b could not be found. Aug 11 11:05:00.649451 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: action_args: {'id': '89f57d2f-28f8-4ad2-8b20-e6533726993b'} Aug 11 11:05:00.650348 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 11:05:00.650348 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:05:00.650348 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 11:05:00.650348 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 11:05:00.650348 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 11:05:00.650348 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 11:05:00.650348 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 11:05:00.650348 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 11:05:00.650348 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 11:05:00.650348 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 11:05:00.650348 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89f57d2f-28f8-4ad2-8b20-e6533726993b could not be found. Aug 11 11:05:00.650348 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:05:00.650348 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:05:00.650348 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:05:00.650348 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:05:00.650348 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:05:00.650348 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:05:00.650348 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 11:05:00.650348 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 11:05:00.650348 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 11:05:00.651488 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 11:05:00.651488 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 11:05:00.651488 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 11:05:00.651488 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 11:05:00.651488 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 11:05:00.651488 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 11:05:00.651488 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 11:05:00.651488 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89f57d2f-28f8-4ad2-8b20-e6533726993b could not be found. Aug 11 11:05:00.651488 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:05:00.651488 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:05:00.651488 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:05:00.651488 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:05:00.651488 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:05:00.651488 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:05:00.651488 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 11:05:00.651488 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 11:05:00.651488 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89f57d2f-28f8-4ad2-8b20-e6533726993b could not be found. Aug 11 11:05:00.651488 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:05:00.652527 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-ff8609c1-288b-4a4c-a5a3-e90201bd8853 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Returning 404 to user: Instance 89f57d2f-28f8-4ad2-8b20-e6533726993b could not be found. {{(pid=121231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 11:05:00.652527 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-ff8609c1-288b-4a4c-a5a3-e90201bd8853 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] 10.222.0.48 "GET /compute/v2.1/servers/89f57d2f-28f8-4ad2-8b20-e6533726993b" status: 404 len: 111 microversion: 2.1 time: 0.042566 Aug 11 11:05:00.652527 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 91/187] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:05:00 2022] GET /compute/v2.1/servers/89f57d2f-28f8-4ad2-8b20-e6533726993b => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 11:05:00.819596 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-b040792a-651f-4ae1-885c-d8cfed8d5290 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:05:00.821744 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-b040792a-651f-4ae1-885c-d8cfed8d5290 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] [instance: 89f57d2f-28f8-4ad2-8b20-e6533726993b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:05:00.828036 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b040792a-651f-4ae1-885c-d8cfed8d5290 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:00.828520 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b040792a-651f-4ae1-885c-d8cfed8d5290 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:00.829122 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b040792a-651f-4ae1-885c-d8cfed8d5290 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:00.829816 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b040792a-651f-4ae1-885c-d8cfed8d5290 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:00.830262 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b040792a-651f-4ae1-885c-d8cfed8d5290 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:00.830855 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b040792a-651f-4ae1-885c-d8cfed8d5290 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:00.834668 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:05:00.853566 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.wsgi [None req-b040792a-651f-4ae1-885c-d8cfed8d5290 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] HTTP exception thrown: Instance 89f57d2f-28f8-4ad2-8b20-e6533726993b could not be found. Aug 11 11:05:00.859487 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-b040792a-651f-4ae1-885c-d8cfed8d5290 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Request method failure captured: Aug 11 11:05:00.859487 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: request: GET /compute/v2.1/servers/89f57d2f-28f8-4ad2-8b20-e6533726993b/os-volume_attachments HTTP/1.1 Aug 11 11:05:00.859487 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Accept: application/json Aug 11 11:05:00.859487 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Accept-Encoding: identity Aug 11 11:05:00.859487 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Connection: close Aug 11 11:05:00.859487 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Content-Length: 0 Aug 11 11:05:00.859487 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Content-Type: application/json Aug 11 11:05:00.859487 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Host: 10.222.0.48 Aug 11 11:05:00.859487 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Openstack-System-Scope: None Aug 11 11:05:00.859487 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: User-Agent: python-urllib3/1.26.11 Aug 11 11:05:00.859487 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Auth-Token: gAAAAABi9OIX5xYECmejmoRvdO0tSj1pB9kIA0rioYjIgMmyiJxATTJ3UZXjCxbvnUx6TqO34mJEpAYd_n-veVlY83bzUJsMbHxbY_aEzFFNsy_Hf0EUUX1kVFhtCwizdlfRoVa04FXPCUKapd6ZZiwglE5a6YdesUJ89sL-DpiUeKlspl1TOos Aug 11 11:05:00.859487 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Domain-Id: None Aug 11 11:05:00.859487 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Domain-Name: None Aug 11 11:05:00.859487 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Identity-Status: Confirmed Aug 11 11:05:00.859487 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Is-Admin-Project: True Aug 11 11:05:00.859487 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Domain-Id: default Aug 11 11:05:00.859487 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Domain-Name: Default Aug 11 11:05:00.859487 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Id: cbb076c769694966bbfea2f23ea8b8a4 Aug 11 11:05:00.859487 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Name: tempest-DeleteServersTestJSON-867048334 Aug 11 11:05:00.859487 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Role: reader,member Aug 11 11:05:00.859487 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Roles: reader,member Aug 11 11:05:00.860876 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/cbb076c769694966bbfea2f23ea8b8a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/cbb076c769694966bbfea2f23ea8b8a4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/cbb076c769694966bbfea2f23ea8b8a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_cbb076c769694966bbfea2f23ea8b8a4", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] Aug 11 11:05:00.860876 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Tenant: tempest-DeleteServersTestJSON-867048334 Aug 11 11:05:00.860876 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Tenant-Id: cbb076c769694966bbfea2f23ea8b8a4 Aug 11 11:05:00.860876 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Tenant-Name: tempest-DeleteServersTestJSON-867048334 Aug 11 11:05:00.860876 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User: tempest-DeleteServersTestJSON-867048334-project Aug 11 11:05:00.860876 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Domain-Id: default Aug 11 11:05:00.860876 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Domain-Name: Default Aug 11 11:05:00.860876 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Id: 2d6fc583bb8a4434b0c6538c9ffbde75 Aug 11 11:05:00.860876 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Name: tempest-DeleteServersTestJSON-867048334-project Aug 11 11:05:00.860876 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: method: > Aug 11 11:05:00.860876 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: exception: Instance 89f57d2f-28f8-4ad2-8b20-e6533726993b could not be found. Aug 11 11:05:00.860876 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: action_args: {'server_id': '89f57d2f-28f8-4ad2-8b20-e6533726993b'} Aug 11 11:05:00.861526 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 11:05:00.861526 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:05:00.861526 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 11:05:00.861526 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 11:05:00.861526 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 11:05:00.861526 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 11:05:00.861526 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 11:05:00.861526 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 11:05:00.861526 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 11:05:00.861526 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 11:05:00.861526 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89f57d2f-28f8-4ad2-8b20-e6533726993b could not be found. Aug 11 11:05:00.861526 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:05:00.861526 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:05:00.861526 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:05:00.861526 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:05:00.861526 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:05:00.861526 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:05:00.861526 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 11:05:00.861526 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 11:05:00.861526 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 11:05:00.862614 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 11:05:00.862614 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 11 11:05:00.862614 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 11 11:05:00.862614 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 11 11:05:00.862614 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 11 11:05:00.862614 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 11 11:05:00.862614 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 11 11:05:00.862614 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 11:05:00.862614 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 11:05:00.862614 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89f57d2f-28f8-4ad2-8b20-e6533726993b could not be found. Aug 11 11:05:00.862614 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:05:00.862614 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:05:00.862614 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:05:00.862614 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:05:00.862614 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:05:00.862614 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:05:00.862614 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 11:05:00.862614 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 11:05:00.862614 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89f57d2f-28f8-4ad2-8b20-e6533726993b could not be found. Aug 11 11:05:00.862614 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:05:00.863731 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-b040792a-651f-4ae1-885c-d8cfed8d5290 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Returning 404 to user: Instance 89f57d2f-28f8-4ad2-8b20-e6533726993b could not be found. {{(pid=121232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 11:05:00.863731 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-b040792a-651f-4ae1-885c-d8cfed8d5290 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] 10.222.0.48 "GET /compute/v2.1/servers/89f57d2f-28f8-4ad2-8b20-e6533726993b/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.046287 Aug 11 11:05:00.863731 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 97/188] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Aug 11 11:05:00 2022] GET /compute/v2.1/servers/89f57d2f-28f8-4ad2-8b20-e6533726993b/os-volume_attachments => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 11:05:01.495902 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-b2d9598e-f03a-4375-958e-f87e8e643bc1 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:05:01.496521 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-b2d9598e-f03a-4375-958e-f87e8e643bc1 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: a09cb964-88a4-4fad-ae60-efb0a7a7dec2] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:05:01.502632 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b2d9598e-f03a-4375-958e-f87e8e643bc1 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:01.503049 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b2d9598e-f03a-4375-958e-f87e8e643bc1 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:01.503510 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b2d9598e-f03a-4375-958e-f87e8e643bc1 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:01.504220 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b2d9598e-f03a-4375-958e-f87e8e643bc1 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:01.504671 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b2d9598e-f03a-4375-958e-f87e8e643bc1 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:01.505100 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b2d9598e-f03a-4375-958e-f87e8e643bc1 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:01.638046 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-b2d9598e-f03a-4375-958e-f87e8e643bc1 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:05:01.645902 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-b2d9598e-f03a-4375-958e-f87e8e643bc1 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2" status: 200 len: 1520 microversion: 2.1 time: 0.154402 Aug 11 11:05:01.647138 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 92/189] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:05:01 2022] GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:05:02.385698 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-b3cecd03-6565-42f0-a4f5-3845427b120e tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:05:02.386247 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-b3cecd03-6565-42f0-a4f5-3845427b120e tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] [instance: 89f57d2f-28f8-4ad2-8b20-e6533726993b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:05:02.392981 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b3cecd03-6565-42f0-a4f5-3845427b120e tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:02.393463 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b3cecd03-6565-42f0-a4f5-3845427b120e tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:02.393896 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b3cecd03-6565-42f0-a4f5-3845427b120e tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:02.394581 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b3cecd03-6565-42f0-a4f5-3845427b120e tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:02.395031 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b3cecd03-6565-42f0-a4f5-3845427b120e tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:02.395452 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b3cecd03-6565-42f0-a4f5-3845427b120e tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:02.409218 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.wsgi [None req-b3cecd03-6565-42f0-a4f5-3845427b120e tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] HTTP exception thrown: Instance 89f57d2f-28f8-4ad2-8b20-e6533726993b could not be found. Aug 11 11:05:02.411463 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-b3cecd03-6565-42f0-a4f5-3845427b120e tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Request method failure captured: Aug 11 11:05:02.411463 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: request: DELETE /compute/v2.1/servers/89f57d2f-28f8-4ad2-8b20-e6533726993b HTTP/1.1 Aug 11 11:05:02.411463 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Accept: application/json Aug 11 11:05:02.411463 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Accept-Encoding: identity Aug 11 11:05:02.411463 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Connection: close Aug 11 11:05:02.411463 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Content-Length: 0 Aug 11 11:05:02.411463 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Content-Type: application/json Aug 11 11:05:02.411463 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Host: 10.222.0.48 Aug 11 11:05:02.411463 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Openstack-System-Scope: None Aug 11 11:05:02.411463 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: User-Agent: python-urllib3/1.26.11 Aug 11 11:05:02.411463 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Auth-Token: gAAAAABi9OIX5xYECmejmoRvdO0tSj1pB9kIA0rioYjIgMmyiJxATTJ3UZXjCxbvnUx6TqO34mJEpAYd_n-veVlY83bzUJsMbHxbY_aEzFFNsy_Hf0EUUX1kVFhtCwizdlfRoVa04FXPCUKapd6ZZiwglE5a6YdesUJ89sL-DpiUeKlspl1TOos Aug 11 11:05:02.411463 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Domain-Id: None Aug 11 11:05:02.411463 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Domain-Name: None Aug 11 11:05:02.411463 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Identity-Status: Confirmed Aug 11 11:05:02.411463 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Is-Admin-Project: True Aug 11 11:05:02.411463 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Domain-Id: default Aug 11 11:05:02.411463 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Domain-Name: Default Aug 11 11:05:02.411463 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Id: cbb076c769694966bbfea2f23ea8b8a4 Aug 11 11:05:02.411463 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Name: tempest-DeleteServersTestJSON-867048334 Aug 11 11:05:02.411463 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Role: reader,member Aug 11 11:05:02.411463 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Roles: reader,member Aug 11 11:05:02.416997 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/cbb076c769694966bbfea2f23ea8b8a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/cbb076c769694966bbfea2f23ea8b8a4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/cbb076c769694966bbfea2f23ea8b8a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_cbb076c769694966bbfea2f23ea8b8a4", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] Aug 11 11:05:02.416997 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Tenant: tempest-DeleteServersTestJSON-867048334 Aug 11 11:05:02.416997 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Tenant-Id: cbb076c769694966bbfea2f23ea8b8a4 Aug 11 11:05:02.416997 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Tenant-Name: tempest-DeleteServersTestJSON-867048334 Aug 11 11:05:02.416997 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User: tempest-DeleteServersTestJSON-867048334-project Aug 11 11:05:02.416997 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Domain-Id: default Aug 11 11:05:02.416997 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Domain-Name: Default Aug 11 11:05:02.416997 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Id: 2d6fc583bb8a4434b0c6538c9ffbde75 Aug 11 11:05:02.416997 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Name: tempest-DeleteServersTestJSON-867048334-project Aug 11 11:05:02.416997 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: method: > Aug 11 11:05:02.416997 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: exception: Instance 89f57d2f-28f8-4ad2-8b20-e6533726993b could not be found. Aug 11 11:05:02.416997 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: action_args: {'id': '89f57d2f-28f8-4ad2-8b20-e6533726993b'} Aug 11 11:05:02.417827 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 11:05:02.417827 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:05:02.417827 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 11:05:02.417827 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 11:05:02.417827 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 11:05:02.417827 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 11:05:02.417827 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 11:05:02.417827 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 11:05:02.417827 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 11:05:02.417827 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 11:05:02.417827 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89f57d2f-28f8-4ad2-8b20-e6533726993b could not be found. Aug 11 11:05:02.417827 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:05:02.417827 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:05:02.417827 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:05:02.417827 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:05:02.417827 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:05:02.417827 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:05:02.417827 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 11:05:02.417827 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 11:05:02.417827 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 11:05:02.419150 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 11:05:02.419150 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 11 11:05:02.419150 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 11 11:05:02.419150 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 11 11:05:02.419150 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 11 11:05:02.419150 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 11:05:02.419150 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 11:05:02.419150 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 11:05:02.419150 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 11:05:02.419150 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89f57d2f-28f8-4ad2-8b20-e6533726993b could not be found. Aug 11 11:05:02.419150 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:05:02.419150 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:05:02.419150 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:05:02.419150 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:05:02.419150 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:05:02.419150 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:05:02.419150 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 11:05:02.419150 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 11:05:02.419150 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89f57d2f-28f8-4ad2-8b20-e6533726993b could not be found. Aug 11 11:05:02.419150 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:05:02.421011 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-b3cecd03-6565-42f0-a4f5-3845427b120e tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Returning 404 to user: Instance 89f57d2f-28f8-4ad2-8b20-e6533726993b could not be found. {{(pid=121232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 11:05:02.421011 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-b3cecd03-6565-42f0-a4f5-3845427b120e tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] 10.222.0.48 "DELETE /compute/v2.1/servers/89f57d2f-28f8-4ad2-8b20-e6533726993b" status: 404 len: 111 microversion: 2.1 time: 0.031820 Aug 11 11:05:02.421011 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 98/190] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Aug 11 11:05:02 2022] DELETE /compute/v2.1/servers/89f57d2f-28f8-4ad2-8b20-e6533726993b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 11:05:02.422960 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-798d583b-9274-4723-ba3d-a45a63e60293 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:05:02.423633 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-798d583b-9274-4723-ba3d-a45a63e60293 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] [instance: 89f57d2f-28f8-4ad2-8b20-e6533726993b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:05:02.431454 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-798d583b-9274-4723-ba3d-a45a63e60293 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:02.431953 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-798d583b-9274-4723-ba3d-a45a63e60293 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:02.432638 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-798d583b-9274-4723-ba3d-a45a63e60293 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:02.433321 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-798d583b-9274-4723-ba3d-a45a63e60293 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:02.433763 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-798d583b-9274-4723-ba3d-a45a63e60293 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:02.434176 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-798d583b-9274-4723-ba3d-a45a63e60293 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:02.438372 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:05:02.450659 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.wsgi [None req-798d583b-9274-4723-ba3d-a45a63e60293 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] HTTP exception thrown: Instance 89f57d2f-28f8-4ad2-8b20-e6533726993b could not be found. Aug 11 11:05:02.452429 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-798d583b-9274-4723-ba3d-a45a63e60293 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Request method failure captured: Aug 11 11:05:02.452429 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: request: GET /compute/v2.1/servers/89f57d2f-28f8-4ad2-8b20-e6533726993b HTTP/1.1 Aug 11 11:05:02.452429 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Accept: application/json Aug 11 11:05:02.452429 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Accept-Encoding: identity Aug 11 11:05:02.452429 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Connection: close Aug 11 11:05:02.452429 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Content-Length: 0 Aug 11 11:05:02.452429 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Content-Type: application/json Aug 11 11:05:02.452429 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Host: 10.222.0.48 Aug 11 11:05:02.452429 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Openstack-System-Scope: None Aug 11 11:05:02.452429 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: User-Agent: python-urllib3/1.26.11 Aug 11 11:05:02.452429 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Auth-Token: gAAAAABi9OIX5xYECmejmoRvdO0tSj1pB9kIA0rioYjIgMmyiJxATTJ3UZXjCxbvnUx6TqO34mJEpAYd_n-veVlY83bzUJsMbHxbY_aEzFFNsy_Hf0EUUX1kVFhtCwizdlfRoVa04FXPCUKapd6ZZiwglE5a6YdesUJ89sL-DpiUeKlspl1TOos Aug 11 11:05:02.452429 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Domain-Id: None Aug 11 11:05:02.452429 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Domain-Name: None Aug 11 11:05:02.452429 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Identity-Status: Confirmed Aug 11 11:05:02.452429 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Is-Admin-Project: True Aug 11 11:05:02.452429 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Domain-Id: default Aug 11 11:05:02.452429 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Domain-Name: Default Aug 11 11:05:02.452429 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Id: cbb076c769694966bbfea2f23ea8b8a4 Aug 11 11:05:02.452429 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Name: tempest-DeleteServersTestJSON-867048334 Aug 11 11:05:02.452429 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Role: reader,member Aug 11 11:05:02.452429 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Roles: reader,member Aug 11 11:05:02.453869 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/cbb076c769694966bbfea2f23ea8b8a4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/cbb076c769694966bbfea2f23ea8b8a4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/cbb076c769694966bbfea2f23ea8b8a4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_cbb076c769694966bbfea2f23ea8b8a4", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] Aug 11 11:05:02.453869 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant: tempest-DeleteServersTestJSON-867048334 Aug 11 11:05:02.453869 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant-Id: cbb076c769694966bbfea2f23ea8b8a4 Aug 11 11:05:02.453869 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant-Name: tempest-DeleteServersTestJSON-867048334 Aug 11 11:05:02.453869 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User: tempest-DeleteServersTestJSON-867048334-project Aug 11 11:05:02.453869 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Domain-Id: default Aug 11 11:05:02.453869 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Domain-Name: Default Aug 11 11:05:02.453869 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Id: 2d6fc583bb8a4434b0c6538c9ffbde75 Aug 11 11:05:02.453869 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Name: tempest-DeleteServersTestJSON-867048334-project Aug 11 11:05:02.453869 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: method: > Aug 11 11:05:02.453869 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: exception: Instance 89f57d2f-28f8-4ad2-8b20-e6533726993b could not be found. Aug 11 11:05:02.453869 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: action_args: {'id': '89f57d2f-28f8-4ad2-8b20-e6533726993b'} Aug 11 11:05:02.454748 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 11:05:02.454748 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:05:02.454748 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 11:05:02.454748 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 11:05:02.454748 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 11:05:02.454748 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 11:05:02.454748 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 11:05:02.454748 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 11:05:02.454748 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 11:05:02.454748 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 11:05:02.454748 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89f57d2f-28f8-4ad2-8b20-e6533726993b could not be found. Aug 11 11:05:02.454748 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:05:02.454748 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:05:02.454748 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:05:02.454748 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:05:02.454748 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:05:02.454748 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:05:02.454748 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 11:05:02.454748 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 11:05:02.454748 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 11:05:02.455988 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 11:05:02.455988 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 11:05:02.455988 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 11:05:02.455988 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 11:05:02.455988 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 11:05:02.455988 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 11:05:02.455988 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 11:05:02.455988 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89f57d2f-28f8-4ad2-8b20-e6533726993b could not be found. Aug 11 11:05:02.455988 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:05:02.455988 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:05:02.455988 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:05:02.455988 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:05:02.455988 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:05:02.455988 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:05:02.455988 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 11:05:02.455988 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 11:05:02.455988 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89f57d2f-28f8-4ad2-8b20-e6533726993b could not be found. Aug 11 11:05:02.455988 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:05:02.457065 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-798d583b-9274-4723-ba3d-a45a63e60293 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] Returning 404 to user: Instance 89f57d2f-28f8-4ad2-8b20-e6533726993b could not be found. {{(pid=121231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 11:05:02.457065 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-798d583b-9274-4723-ba3d-a45a63e60293 tempest-DeleteServersTestJSON-867048334 tempest-DeleteServersTestJSON-867048334-project] 10.222.0.48 "GET /compute/v2.1/servers/89f57d2f-28f8-4ad2-8b20-e6533726993b" status: 404 len: 111 microversion: 2.1 time: 0.036061 Aug 11 11:05:02.457065 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 93/191] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:05:02 2022] GET /compute/v2.1/servers/89f57d2f-28f8-4ad2-8b20-e6533726993b => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 11:05:02.670057 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-8c0b397c-6beb-4bd2-acfb-11b09f5a045d tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:05:02.670764 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-8c0b397c-6beb-4bd2-acfb-11b09f5a045d tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: a09cb964-88a4-4fad-ae60-efb0a7a7dec2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:05:02.687577 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8c0b397c-6beb-4bd2-acfb-11b09f5a045d tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:02.688093 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8c0b397c-6beb-4bd2-acfb-11b09f5a045d tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:02.688530 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8c0b397c-6beb-4bd2-acfb-11b09f5a045d tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:02.689221 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8c0b397c-6beb-4bd2-acfb-11b09f5a045d tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:02.689667 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8c0b397c-6beb-4bd2-acfb-11b09f5a045d tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:02.690166 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8c0b397c-6beb-4bd2-acfb-11b09f5a045d tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:02.957035 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-8c0b397c-6beb-4bd2-acfb-11b09f5a045d tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:05:02.969829 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-8c0b397c-6beb-4bd2-acfb-11b09f5a045d tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2" status: 200 len: 1520 microversion: 2.1 time: 0.304838 Aug 11 11:05:02.970731 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 99/192] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:05:02 2022] GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2 => generated 1520 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:05:03.992314 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-a9cc3ead-146b-4248-8999-399460ed6b7e tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:05:03.993565 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-a9cc3ead-146b-4248-8999-399460ed6b7e tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: a09cb964-88a4-4fad-ae60-efb0a7a7dec2] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:05:04.001915 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a9cc3ead-146b-4248-8999-399460ed6b7e tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:04.002940 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a9cc3ead-146b-4248-8999-399460ed6b7e tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:04.003586 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a9cc3ead-146b-4248-8999-399460ed6b7e tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:04.004561 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a9cc3ead-146b-4248-8999-399460ed6b7e tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:04.005206 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a9cc3ead-146b-4248-8999-399460ed6b7e tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:04.005715 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a9cc3ead-146b-4248-8999-399460ed6b7e tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:04.155699 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-a9cc3ead-146b-4248-8999-399460ed6b7e tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:05:04.164363 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-a9cc3ead-146b-4248-8999-399460ed6b7e tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2" status: 200 len: 1520 microversion: 2.1 time: 0.177650 Aug 11 11:05:04.165292 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 94/193] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:05:03 2022] GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2 => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:05:05.184872 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-cf167c8e-e5a6-442a-854e-9f282fb14175 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:05:05.185510 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-cf167c8e-e5a6-442a-854e-9f282fb14175 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: a09cb964-88a4-4fad-ae60-efb0a7a7dec2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:05:05.192007 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cf167c8e-e5a6-442a-854e-9f282fb14175 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:05.192446 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cf167c8e-e5a6-442a-854e-9f282fb14175 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:05.192884 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cf167c8e-e5a6-442a-854e-9f282fb14175 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:05.193570 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cf167c8e-e5a6-442a-854e-9f282fb14175 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:05.194026 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cf167c8e-e5a6-442a-854e-9f282fb14175 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:05.194944 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cf167c8e-e5a6-442a-854e-9f282fb14175 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:05.357619 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-cf167c8e-e5a6-442a-854e-9f282fb14175 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:05:05.382876 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-cf167c8e-e5a6-442a-854e-9f282fb14175 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2" status: 200 len: 1520 microversion: 2.1 time: 0.201836 Aug 11 11:05:05.383654 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 100/194] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:05:05 2022] GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2 => generated 1520 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:05:05.998494 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-c537a159-441f-4af9-a67b-0cb578599215 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1497168159", "imageRef": "05993162-aafd-4f1d-b781-ec09593713e5", "flavorRef": "452", "networks": [{"uuid": "524e9a03-a779-4c8d-b440-eee39baf1b44"}]}} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:05:06.089150 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.network.neutron [None req-c537a159-441f-4af9-a67b-0cb578599215 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] validate_networks() for [('524e9a03-a779-4c8d-b440-eee39baf1b44', None, None, None, None, None)] {{(pid=121231) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 11 11:05:06.404760 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-4b1bf7fc-97f6-4704-9d78-826c128d2f61 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:05:06.405365 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-4b1bf7fc-97f6-4704-9d78-826c128d2f61 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: a09cb964-88a4-4fad-ae60-efb0a7a7dec2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:05:06.417573 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4b1bf7fc-97f6-4704-9d78-826c128d2f61 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:06.418360 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4b1bf7fc-97f6-4704-9d78-826c128d2f61 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:06.419113 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4b1bf7fc-97f6-4704-9d78-826c128d2f61 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:06.420160 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4b1bf7fc-97f6-4704-9d78-826c128d2f61 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:06.420621 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4b1bf7fc-97f6-4704-9d78-826c128d2f61 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:06.421046 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4b1bf7fc-97f6-4704-9d78-826c128d2f61 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:06.627874 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-c537a159-441f-4af9-a67b-0cb578599215 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Flavor limits 0:0:0 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 11 11:05:06.628286 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-c537a159-441f-4af9-a67b-0cb578599215 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Image limits 0:0:0 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 11 11:05:06.629635 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-c537a159-441f-4af9-a67b-0cb578599215 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Flavor pref 0:0:0 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 11 11:05:06.630190 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-c537a159-441f-4af9-a67b-0cb578599215 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Image pref 0:0:0 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 11 11:05:06.630736 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-c537a159-441f-4af9-a67b-0cb578599215 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 11 11:05:06.646247 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c537a159-441f-4af9-a67b-0cb578599215 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:06.646975 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c537a159-441f-4af9-a67b-0cb578599215 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:06.647586 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c537a159-441f-4af9-a67b-0cb578599215 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:06.648515 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c537a159-441f-4af9-a67b-0cb578599215 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:06.650350 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c537a159-441f-4af9-a67b-0cb578599215 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:06.650985 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c537a159-441f-4af9-a67b-0cb578599215 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:06.681542 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.quota [None req-c537a159-441f-4af9-a67b-0cb578599215 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Getting quotas for project 23c8a1db00944c59950120c030ab47e3. Resources: {'ram', 'cores', 'instances'} {{(pid=121231) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 11:05:06.694037 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.quota [None req-c537a159-441f-4af9-a67b-0cb578599215 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Getting quotas for user f2e7493d38d24493b3298ac37592ecd4 and project 23c8a1db00944c59950120c030ab47e3. Resources: {'ram', 'cores', 'instances'} {{(pid=121231) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 11:05:06.709393 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-c537a159-441f-4af9-a67b-0cb578599215 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Going to run 1 instances... {{(pid=121231) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 11 11:05:06.723675 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-c537a159-441f-4af9-a67b-0cb578599215 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] [instance: b2d65671-2e58-41ac-9aa1-245420900315] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='05993162-aafd-4f1d-b781-ec09593713e5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121231) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 11 11:05:06.737989 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-4b1bf7fc-97f6-4704-9d78-826c128d2f61 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:05:06.756413 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-4b1bf7fc-97f6-4704-9d78-826c128d2f61 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2" status: 200 len: 1520 microversion: 2.1 time: 0.355390 Aug 11 11:05:06.769944 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 101/195] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:05:06 2022] GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2 => generated 1520 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:05:06.869828 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-c537a159-441f-4af9-a67b-0cb578599215 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.877985 Aug 11 11:05:06.871568 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 95/196] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Aug 11 11:05:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 881 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 11 11:05:06.882732 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-a2090a64-25f6-4483-b3b2-be2583a92ac2 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:05:06.883368 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-a2090a64-25f6-4483-b3b2-be2583a92ac2 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] [instance: b2d65671-2e58-41ac-9aa1-245420900315] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:05:06.959119 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-a2090a64-25f6-4483-b3b2-be2583a92ac2 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7493d38d24493b3298ac37592ecd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c8a1db00944c59950120c030ab47e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:05:06.967188 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-a2090a64-25f6-4483-b3b2-be2583a92ac2 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] 10.222.0.48 "GET /compute/v2.1/servers/b2d65671-2e58-41ac-9aa1-245420900315" status: 200 len: 1219 microversion: 2.1 time: 0.088425 Aug 11 11:05:06.967827 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 102/197] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:05:06 2022] GET /compute/v2.1/servers/b2d65671-2e58-41ac-9aa1-245420900315 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:05:07.778304 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-020a435d-9dc2-4f7c-bc15-fb3b77df9e53 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:05:07.778914 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-020a435d-9dc2-4f7c-bc15-fb3b77df9e53 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: a09cb964-88a4-4fad-ae60-efb0a7a7dec2] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:05:07.785933 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-020a435d-9dc2-4f7c-bc15-fb3b77df9e53 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:07.786411 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-020a435d-9dc2-4f7c-bc15-fb3b77df9e53 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:07.786846 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-020a435d-9dc2-4f7c-bc15-fb3b77df9e53 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:07.787540 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-020a435d-9dc2-4f7c-bc15-fb3b77df9e53 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:07.788076 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-020a435d-9dc2-4f7c-bc15-fb3b77df9e53 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:07.788501 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-020a435d-9dc2-4f7c-bc15-fb3b77df9e53 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:07.934418 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-020a435d-9dc2-4f7c-bc15-fb3b77df9e53 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:05:07.942182 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-020a435d-9dc2-4f7c-bc15-fb3b77df9e53 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2" status: 200 len: 1520 microversion: 2.1 time: 0.168344 Aug 11 11:05:07.942746 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 96/198] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:05:07 2022] GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:05:07.988273 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-e519779d-84aa-430f-820c-db8eb6745148 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:05:07.988885 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-e519779d-84aa-430f-820c-db8eb6745148 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] [instance: b2d65671-2e58-41ac-9aa1-245420900315] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:05:08.040879 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-e519779d-84aa-430f-820c-db8eb6745148 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7493d38d24493b3298ac37592ecd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c8a1db00944c59950120c030ab47e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:05:08.048480 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-e519779d-84aa-430f-820c-db8eb6745148 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] 10.222.0.48 "GET /compute/v2.1/servers/b2d65671-2e58-41ac-9aa1-245420900315" status: 200 len: 1219 microversion: 2.1 time: 0.064027 Aug 11 11:05:08.049040 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 103/199] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:05:07 2022] GET /compute/v2.1/servers/b2d65671-2e58-41ac-9aa1-245420900315 => generated 1219 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:05:08.964180 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-a77d7f35-6559-49e0-ad96-62af99242097 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:05:08.965006 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-a77d7f35-6559-49e0-ad96-62af99242097 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: a09cb964-88a4-4fad-ae60-efb0a7a7dec2] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:05:08.976132 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a77d7f35-6559-49e0-ad96-62af99242097 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:08.977347 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a77d7f35-6559-49e0-ad96-62af99242097 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:08.977864 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a77d7f35-6559-49e0-ad96-62af99242097 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:08.978694 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a77d7f35-6559-49e0-ad96-62af99242097 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:08.979221 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a77d7f35-6559-49e0-ad96-62af99242097 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:08.979716 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a77d7f35-6559-49e0-ad96-62af99242097 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:09.070872 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-186bf33c-1528-4824-a42e-f203fed7c7de tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:05:09.071593 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-186bf33c-1528-4824-a42e-f203fed7c7de tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] [instance: b2d65671-2e58-41ac-9aa1-245420900315] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:05:09.078073 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-186bf33c-1528-4824-a42e-f203fed7c7de tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:09.079589 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-186bf33c-1528-4824-a42e-f203fed7c7de tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:09.080226 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-186bf33c-1528-4824-a42e-f203fed7c7de tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:09.080946 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-186bf33c-1528-4824-a42e-f203fed7c7de tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:09.081406 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-186bf33c-1528-4824-a42e-f203fed7c7de tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:09.081831 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-186bf33c-1528-4824-a42e-f203fed7c7de tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:09.116718 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-a77d7f35-6559-49e0-ad96-62af99242097 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:05:09.124262 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-a77d7f35-6559-49e0-ad96-62af99242097 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2" status: 200 len: 1500 microversion: 2.1 time: 0.164706 Aug 11 11:05:09.124841 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 97/200] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:05:08 2022] GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2 => generated 1500 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:05:09.145103 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-951c6784-51c5-4e4b-bc8a-c7f9591b232e tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:05:09.145487 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-186bf33c-1528-4824-a42e-f203fed7c7de tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7493d38d24493b3298ac37592ecd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c8a1db00944c59950120c030ab47e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:05:09.145777 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-951c6784-51c5-4e4b-bc8a-c7f9591b232e tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 7cfaa606-ef7e-4594-aaba-72be96386bd7] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:05:09.153364 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-951c6784-51c5-4e4b-bc8a-c7f9591b232e tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:09.153857 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-951c6784-51c5-4e4b-bc8a-c7f9591b232e tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:09.154795 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-951c6784-51c5-4e4b-bc8a-c7f9591b232e tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:09.155496 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-951c6784-51c5-4e4b-bc8a-c7f9591b232e tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:09.155981 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-951c6784-51c5-4e4b-bc8a-c7f9591b232e tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:09.156401 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-951c6784-51c5-4e4b-bc8a-c7f9591b232e tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:09.157193 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-186bf33c-1528-4824-a42e-f203fed7c7de tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] 10.222.0.48 "GET /compute/v2.1/servers/b2d65671-2e58-41ac-9aa1-245420900315" status: 200 len: 1223 microversion: 2.1 time: 0.091669 Aug 11 11:05:09.157783 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 104/201] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:05:09 2022] GET /compute/v2.1/servers/b2d65671-2e58-41ac-9aa1-245420900315 => generated 1223 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:05:09.306063 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-951c6784-51c5-4e4b-bc8a-c7f9591b232e tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:05:09.314059 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-951c6784-51c5-4e4b-bc8a-c7f9591b232e tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/7cfaa606-ef7e-4594-aaba-72be96386bd7" status: 200 len: 1514 microversion: 2.1 time: 0.173453 Aug 11 11:05:09.315028 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 98/202] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:05:09 2022] GET /compute/v2.1/servers/7cfaa606-ef7e-4594-aaba-72be96386bd7 => generated 1514 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:05:10.179136 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-aa592c24-5ecb-4a1d-95fd-3305af4c4d14 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:05:10.179740 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-aa592c24-5ecb-4a1d-95fd-3305af4c4d14 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] [instance: b2d65671-2e58-41ac-9aa1-245420900315] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:05:10.187518 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-aa592c24-5ecb-4a1d-95fd-3305af4c4d14 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:10.188882 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-aa592c24-5ecb-4a1d-95fd-3305af4c4d14 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:10.189446 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-aa592c24-5ecb-4a1d-95fd-3305af4c4d14 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:10.192759 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-aa592c24-5ecb-4a1d-95fd-3305af4c4d14 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:10.193268 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-aa592c24-5ecb-4a1d-95fd-3305af4c4d14 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:10.197371 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-aa592c24-5ecb-4a1d-95fd-3305af4c4d14 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:10.275318 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-aa592c24-5ecb-4a1d-95fd-3305af4c4d14 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7493d38d24493b3298ac37592ecd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c8a1db00944c59950120c030ab47e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:05:10.292935 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-aa592c24-5ecb-4a1d-95fd-3305af4c4d14 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] 10.222.0.48 "GET /compute/v2.1/servers/b2d65671-2e58-41ac-9aa1-245420900315" status: 200 len: 1279 microversion: 2.1 time: 0.118021 Aug 11 11:05:10.293555 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 105/203] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:05:10 2022] GET /compute/v2.1/servers/b2d65671-2e58-41ac-9aa1-245420900315 => generated 1279 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:05:11.148485 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-48da0e98-fb58-40cc-af1f-6423a892389b tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:05:11.152350 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-48da0e98-fb58-40cc-af1f-6423a892389b tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 7cfaa606-ef7e-4594-aaba-72be96386bd7] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:05:11.161476 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-48da0e98-fb58-40cc-af1f-6423a892389b tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:11.161977 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-48da0e98-fb58-40cc-af1f-6423a892389b tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:11.163046 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-48da0e98-fb58-40cc-af1f-6423a892389b tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:11.163786 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-48da0e98-fb58-40cc-af1f-6423a892389b tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:11.164396 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-48da0e98-fb58-40cc-af1f-6423a892389b tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:11.165125 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-48da0e98-fb58-40cc-af1f-6423a892389b tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:11.194385 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.objects.instance [None req-48da0e98-fb58-40cc-af1f-6423a892389b tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lazy-loading 'flavor' on Instance uuid 7cfaa606-ef7e-4594-aaba-72be96386bd7 {{(pid=121231) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 11:05:11.314938 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-344e6854-1178-4e62-a0c5-b6d7fcaad969 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:05:11.315631 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-344e6854-1178-4e62-a0c5-b6d7fcaad969 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] [instance: b2d65671-2e58-41ac-9aa1-245420900315] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:05:11.322028 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-344e6854-1178-4e62-a0c5-b6d7fcaad969 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:11.322620 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-344e6854-1178-4e62-a0c5-b6d7fcaad969 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:11.323104 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-344e6854-1178-4e62-a0c5-b6d7fcaad969 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:11.323895 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-344e6854-1178-4e62-a0c5-b6d7fcaad969 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:11.324345 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-344e6854-1178-4e62-a0c5-b6d7fcaad969 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:11.324780 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-344e6854-1178-4e62-a0c5-b6d7fcaad969 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:11.592931 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-48da0e98-fb58-40cc-af1f-6423a892389b tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "POST /compute/v2.1/servers/7cfaa606-ef7e-4594-aaba-72be96386bd7/action" status: 200 len: 32 microversion: 2.1 time: 0.454519 Aug 11 11:05:11.593568 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 99/204] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Aug 11 11:05:11 2022] POST /compute/v2.1/servers/7cfaa606-ef7e-4594-aaba-72be96386bd7/action => generated 32 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 11 11:05:11.605292 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-aec5d1d6-43c6-469e-8e3a-b6d386b5c91d tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:05:11.606283 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-aec5d1d6-43c6-469e-8e3a-b6d386b5c91d tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 7cfaa606-ef7e-4594-aaba-72be96386bd7] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:05:11.616444 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-aec5d1d6-43c6-469e-8e3a-b6d386b5c91d tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:11.616949 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-aec5d1d6-43c6-469e-8e3a-b6d386b5c91d tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:11.617377 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-aec5d1d6-43c6-469e-8e3a-b6d386b5c91d tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:11.618077 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-aec5d1d6-43c6-469e-8e3a-b6d386b5c91d tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:11.618524 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-aec5d1d6-43c6-469e-8e3a-b6d386b5c91d tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:11.618945 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-aec5d1d6-43c6-469e-8e3a-b6d386b5c91d tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:11.771142 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-344e6854-1178-4e62-a0c5-b6d7fcaad969 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7493d38d24493b3298ac37592ecd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c8a1db00944c59950120c030ab47e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:05:11.792346 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-344e6854-1178-4e62-a0c5-b6d7fcaad969 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] 10.222.0.48 "GET /compute/v2.1/servers/b2d65671-2e58-41ac-9aa1-245420900315" status: 200 len: 1319 microversion: 2.1 time: 0.477003 Aug 11 11:05:11.795121 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 106/205] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:05:11 2022] GET /compute/v2.1/servers/b2d65671-2e58-41ac-9aa1-245420900315 => generated 1319 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:05:11.882170 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-aec5d1d6-43c6-469e-8e3a-b6d386b5c91d tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:05:11.892238 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-aec5d1d6-43c6-469e-8e3a-b6d386b5c91d tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/7cfaa606-ef7e-4594-aaba-72be96386bd7" status: 200 len: 1520 microversion: 2.1 time: 0.291993 Aug 11 11:05:11.892829 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 100/206] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:05:11 2022] GET /compute/v2.1/servers/7cfaa606-ef7e-4594-aaba-72be96386bd7 => generated 1520 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:05:12.447733 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-2aa7133c-bff1-4006-ab82-36e58a622606 req-8c97a132-2bf4-4ed3-aedb-a7b0fdecd3a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2d65671-2e58-41ac-9aa1-245420900315", "tag": "f9bf133d-cd7d-427c-affe-dd52652cff0c"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:05:12.463403 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_api:SELECT=50 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:05:12.465408 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-2aa7133c-bff1-4006-ab82-36e58a622606 req-8c97a132-2bf4-4ed3-aedb-a7b0fdecd3a1 service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:12.466010 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-2aa7133c-bff1-4006-ab82-36e58a622606 req-8c97a132-2bf4-4ed3-aedb-a7b0fdecd3a1 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:12.466580 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-2aa7133c-bff1-4006-ab82-36e58a622606 req-8c97a132-2bf4-4ed3-aedb-a7b0fdecd3a1 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:12.480483 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-2aa7133c-bff1-4006-ab82-36e58a622606 req-8c97a132-2bf4-4ed3-aedb-a7b0fdecd3a1 service nova] Creating event network-changed:f9bf133d-cd7d-427c-affe-dd52652cff0c for instance b2d65671-2e58-41ac-9aa1-245420900315 on hv-cinder-82002 Aug 11 11:05:12.486494 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-2aa7133c-bff1-4006-ab82-36e58a622606 req-8c97a132-2bf4-4ed3-aedb-a7b0fdecd3a1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046504 Aug 11 11:05:12.487221 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 107/207] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:05:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:05:12.824890 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-0757dc58-9bcc-4275-9907-977016cd0015 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:05:12.825734 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-0757dc58-9bcc-4275-9907-977016cd0015 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] [instance: b2d65671-2e58-41ac-9aa1-245420900315] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:05:12.832584 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0757dc58-9bcc-4275-9907-977016cd0015 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:12.833067 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0757dc58-9bcc-4275-9907-977016cd0015 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:12.836818 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0757dc58-9bcc-4275-9907-977016cd0015 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:12.836818 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0757dc58-9bcc-4275-9907-977016cd0015 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:12.836818 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0757dc58-9bcc-4275-9907-977016cd0015 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:12.836818 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0757dc58-9bcc-4275-9907-977016cd0015 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:12.914916 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-f6dbd424-0ed8-4ee3-b319-d4f2b00cd52f tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:05:12.915834 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-f6dbd424-0ed8-4ee3-b319-d4f2b00cd52f tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 7cfaa606-ef7e-4594-aaba-72be96386bd7] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:05:12.921904 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f6dbd424-0ed8-4ee3-b319-d4f2b00cd52f tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:12.922383 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f6dbd424-0ed8-4ee3-b319-d4f2b00cd52f tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:12.922808 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f6dbd424-0ed8-4ee3-b319-d4f2b00cd52f tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:12.923486 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f6dbd424-0ed8-4ee3-b319-d4f2b00cd52f tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:12.924014 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f6dbd424-0ed8-4ee3-b319-d4f2b00cd52f tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:12.924440 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f6dbd424-0ed8-4ee3-b319-d4f2b00cd52f tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:13.107015 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-0757dc58-9bcc-4275-9907-977016cd0015 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7493d38d24493b3298ac37592ecd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c8a1db00944c59950120c030ab47e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:05:13.114741 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-0757dc58-9bcc-4275-9907-977016cd0015 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] 10.222.0.48 "GET /compute/v2.1/servers/b2d65671-2e58-41ac-9aa1-245420900315" status: 200 len: 1319 microversion: 2.1 time: 0.293902 Aug 11 11:05:13.115310 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 101/208] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:05:12 2022] GET /compute/v2.1/servers/b2d65671-2e58-41ac-9aa1-245420900315 => generated 1319 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:05:13.205972 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-f6dbd424-0ed8-4ee3-b319-d4f2b00cd52f tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:05:13.213665 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-f6dbd424-0ed8-4ee3-b319-d4f2b00cd52f tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/7cfaa606-ef7e-4594-aaba-72be96386bd7" status: 200 len: 1520 microversion: 2.1 time: 0.303226 Aug 11 11:05:13.214234 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 108/209] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:05:12 2022] GET /compute/v2.1/servers/7cfaa606-ef7e-4594-aaba-72be96386bd7 => generated 1520 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:05:14.136423 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-307113c6-734c-41fd-a242-70bf4b579966 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:05:14.137024 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-307113c6-734c-41fd-a242-70bf4b579966 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] [instance: b2d65671-2e58-41ac-9aa1-245420900315] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:05:14.143445 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-307113c6-734c-41fd-a242-70bf4b579966 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:14.143952 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-307113c6-734c-41fd-a242-70bf4b579966 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:14.144383 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-307113c6-734c-41fd-a242-70bf4b579966 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:14.145053 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-307113c6-734c-41fd-a242-70bf4b579966 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:14.145495 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-307113c6-734c-41fd-a242-70bf4b579966 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:14.145907 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-307113c6-734c-41fd-a242-70bf4b579966 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:14.235651 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-fece1c9f-30a8-40ff-a39e-e7999a44838a tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:05:14.236864 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-fece1c9f-30a8-40ff-a39e-e7999a44838a tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 7cfaa606-ef7e-4594-aaba-72be96386bd7] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:05:14.243558 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fece1c9f-30a8-40ff-a39e-e7999a44838a tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:14.244073 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fece1c9f-30a8-40ff-a39e-e7999a44838a tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:14.244514 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fece1c9f-30a8-40ff-a39e-e7999a44838a tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:14.245207 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fece1c9f-30a8-40ff-a39e-e7999a44838a tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:14.245663 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fece1c9f-30a8-40ff-a39e-e7999a44838a tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:14.246086 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fece1c9f-30a8-40ff-a39e-e7999a44838a tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:14.280811 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-307113c6-734c-41fd-a242-70bf4b579966 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7493d38d24493b3298ac37592ecd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c8a1db00944c59950120c030ab47e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:05:14.289005 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-307113c6-734c-41fd-a242-70bf4b579966 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] 10.222.0.48 "GET /compute/v2.1/servers/b2d65671-2e58-41ac-9aa1-245420900315" status: 200 len: 1319 microversion: 2.1 time: 0.156431 Aug 11 11:05:14.289592 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 102/210] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:05:14 2022] GET /compute/v2.1/servers/b2d65671-2e58-41ac-9aa1-245420900315 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:05:14.373414 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-fece1c9f-30a8-40ff-a39e-e7999a44838a tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:05:14.381064 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-fece1c9f-30a8-40ff-a39e-e7999a44838a tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/7cfaa606-ef7e-4594-aaba-72be96386bd7" status: 200 len: 1520 microversion: 2.1 time: 0.150368 Aug 11 11:05:14.381638 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 109/211] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:05:14 2022] GET /compute/v2.1/servers/7cfaa606-ef7e-4594-aaba-72be96386bd7 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:05:15.310146 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-5b910cd5-3123-41a3-bfcc-411ab4890237 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:05:15.310780 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-5b910cd5-3123-41a3-bfcc-411ab4890237 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] [instance: b2d65671-2e58-41ac-9aa1-245420900315] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:05:15.317223 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5b910cd5-3123-41a3-bfcc-411ab4890237 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:15.317702 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5b910cd5-3123-41a3-bfcc-411ab4890237 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:15.318127 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5b910cd5-3123-41a3-bfcc-411ab4890237 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:15.318908 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5b910cd5-3123-41a3-bfcc-411ab4890237 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:15.319352 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5b910cd5-3123-41a3-bfcc-411ab4890237 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:15.319784 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5b910cd5-3123-41a3-bfcc-411ab4890237 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:15.402110 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-ce87ca12-dde4-415a-8af8-d0ad47b98f7d tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:05:15.402722 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-ce87ca12-dde4-415a-8af8-d0ad47b98f7d tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 7cfaa606-ef7e-4594-aaba-72be96386bd7] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:05:15.408767 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ce87ca12-dde4-415a-8af8-d0ad47b98f7d tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:15.409252 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ce87ca12-dde4-415a-8af8-d0ad47b98f7d tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:15.409682 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ce87ca12-dde4-415a-8af8-d0ad47b98f7d tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:15.410363 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ce87ca12-dde4-415a-8af8-d0ad47b98f7d tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:15.410813 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ce87ca12-dde4-415a-8af8-d0ad47b98f7d tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:15.411233 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ce87ca12-dde4-415a-8af8-d0ad47b98f7d tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:15.457354 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-5b910cd5-3123-41a3-bfcc-411ab4890237 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7493d38d24493b3298ac37592ecd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c8a1db00944c59950120c030ab47e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:05:15.465361 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-5b910cd5-3123-41a3-bfcc-411ab4890237 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] 10.222.0.48 "GET /compute/v2.1/servers/b2d65671-2e58-41ac-9aa1-245420900315" status: 200 len: 1319 microversion: 2.1 time: 0.159429 Aug 11 11:05:15.465939 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 103/212] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:05:15 2022] GET /compute/v2.1/servers/b2d65671-2e58-41ac-9aa1-245420900315 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:05:15.538542 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-ce87ca12-dde4-415a-8af8-d0ad47b98f7d tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:05:15.545933 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-ce87ca12-dde4-415a-8af8-d0ad47b98f7d tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/7cfaa606-ef7e-4594-aaba-72be96386bd7" status: 200 len: 1520 microversion: 2.1 time: 0.147597 Aug 11 11:05:15.546502 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 110/213] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:05:15 2022] GET /compute/v2.1/servers/7cfaa606-ef7e-4594-aaba-72be96386bd7 => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:05:16.486370 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-cc4c4194-cdb6-48cd-bac0-2cd57a910d15 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:05:16.486979 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-cc4c4194-cdb6-48cd-bac0-2cd57a910d15 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] [instance: b2d65671-2e58-41ac-9aa1-245420900315] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:05:16.493549 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-cc4c4194-cdb6-48cd-bac0-2cd57a910d15 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:16.494033 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-cc4c4194-cdb6-48cd-bac0-2cd57a910d15 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:16.494467 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-cc4c4194-cdb6-48cd-bac0-2cd57a910d15 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:16.495154 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-cc4c4194-cdb6-48cd-bac0-2cd57a910d15 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:16.495603 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-cc4c4194-cdb6-48cd-bac0-2cd57a910d15 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:16.496055 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-cc4c4194-cdb6-48cd-bac0-2cd57a910d15 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:16.566493 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-bf88a6be-b5fc-4c54-9183-b2a0094a7afc tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:05:16.567100 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-bf88a6be-b5fc-4c54-9183-b2a0094a7afc tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 7cfaa606-ef7e-4594-aaba-72be96386bd7] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:05:16.573288 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bf88a6be-b5fc-4c54-9183-b2a0094a7afc tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:16.574296 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bf88a6be-b5fc-4c54-9183-b2a0094a7afc tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:16.574730 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bf88a6be-b5fc-4c54-9183-b2a0094a7afc tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:16.575424 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bf88a6be-b5fc-4c54-9183-b2a0094a7afc tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:16.575914 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bf88a6be-b5fc-4c54-9183-b2a0094a7afc tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:16.577405 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bf88a6be-b5fc-4c54-9183-b2a0094a7afc tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:16.660451 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-cc4c4194-cdb6-48cd-bac0-2cd57a910d15 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7493d38d24493b3298ac37592ecd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c8a1db00944c59950120c030ab47e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:05:16.662972 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell0:SELECT=2 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:05:16.668974 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-cc4c4194-cdb6-48cd-bac0-2cd57a910d15 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] 10.222.0.48 "GET /compute/v2.1/servers/b2d65671-2e58-41ac-9aa1-245420900315" status: 200 len: 1319 microversion: 2.1 time: 0.186424 Aug 11 11:05:16.669586 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 104/214] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:05:16 2022] GET /compute/v2.1/servers/b2d65671-2e58-41ac-9aa1-245420900315 => generated 1319 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:05:16.721690 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-bf88a6be-b5fc-4c54-9183-b2a0094a7afc tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:05:16.729224 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-bf88a6be-b5fc-4c54-9183-b2a0094a7afc tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/7cfaa606-ef7e-4594-aaba-72be96386bd7" status: 200 len: 1520 microversion: 2.1 time: 0.166685 Aug 11 11:05:16.729790 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 111/215] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:05:16 2022] GET /compute/v2.1/servers/7cfaa606-ef7e-4594-aaba-72be96386bd7 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:05:17.689811 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-f2566d1e-6c34-46da-b7fb-9aa22723e00b tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:05:17.690416 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-f2566d1e-6c34-46da-b7fb-9aa22723e00b tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] [instance: b2d65671-2e58-41ac-9aa1-245420900315] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:05:17.692635 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell0:SELECT=6 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:05:17.697991 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f2566d1e-6c34-46da-b7fb-9aa22723e00b tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:17.698468 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f2566d1e-6c34-46da-b7fb-9aa22723e00b tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:17.698900 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f2566d1e-6c34-46da-b7fb-9aa22723e00b tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:17.699579 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f2566d1e-6c34-46da-b7fb-9aa22723e00b tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:17.700052 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f2566d1e-6c34-46da-b7fb-9aa22723e00b tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:17.700475 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f2566d1e-6c34-46da-b7fb-9aa22723e00b tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:17.752742 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-535be27f-af5e-4053-9601-e6abb72d3abb tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:05:17.753356 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-535be27f-af5e-4053-9601-e6abb72d3abb tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 7cfaa606-ef7e-4594-aaba-72be96386bd7] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:05:17.765181 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-535be27f-af5e-4053-9601-e6abb72d3abb tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:17.766731 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-535be27f-af5e-4053-9601-e6abb72d3abb tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:17.767185 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-535be27f-af5e-4053-9601-e6abb72d3abb tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:17.767939 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-535be27f-af5e-4053-9601-e6abb72d3abb tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:17.768380 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-535be27f-af5e-4053-9601-e6abb72d3abb tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:17.768807 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-535be27f-af5e-4053-9601-e6abb72d3abb tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:17.881820 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-f2566d1e-6c34-46da-b7fb-9aa22723e00b tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7493d38d24493b3298ac37592ecd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c8a1db00944c59950120c030ab47e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:05:17.890276 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-f2566d1e-6c34-46da-b7fb-9aa22723e00b tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] 10.222.0.48 "GET /compute/v2.1/servers/b2d65671-2e58-41ac-9aa1-245420900315" status: 200 len: 1319 microversion: 2.1 time: 0.204189 Aug 11 11:05:17.890860 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 105/216] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:05:17 2022] GET /compute/v2.1/servers/b2d65671-2e58-41ac-9aa1-245420900315 => generated 1319 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:05:17.926363 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-535be27f-af5e-4053-9601-e6abb72d3abb tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:05:17.934955 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-535be27f-af5e-4053-9601-e6abb72d3abb tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/7cfaa606-ef7e-4594-aaba-72be96386bd7" status: 200 len: 1520 microversion: 2.1 time: 0.185873 Aug 11 11:05:17.935591 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 112/217] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:05:17 2022] GET /compute/v2.1/servers/7cfaa606-ef7e-4594-aaba-72be96386bd7 => generated 1520 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:05:18.912595 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-2b643591-8177-4e25-9675-4dbff2072b4e tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:05:18.913200 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-2b643591-8177-4e25-9675-4dbff2072b4e tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] [instance: b2d65671-2e58-41ac-9aa1-245420900315] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:05:18.919619 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2b643591-8177-4e25-9675-4dbff2072b4e tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:18.920255 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2b643591-8177-4e25-9675-4dbff2072b4e tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:18.920691 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2b643591-8177-4e25-9675-4dbff2072b4e tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:18.921369 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2b643591-8177-4e25-9675-4dbff2072b4e tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:18.921822 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2b643591-8177-4e25-9675-4dbff2072b4e tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:18.922232 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2b643591-8177-4e25-9675-4dbff2072b4e tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:18.957683 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-3aaeb7af-9d14-4b34-b687-cb149f4a8987 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:05:18.959031 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-3aaeb7af-9d14-4b34-b687-cb149f4a8987 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 7cfaa606-ef7e-4594-aaba-72be96386bd7] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:05:18.961597 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell0:SELECT=4 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:05:18.967030 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3aaeb7af-9d14-4b34-b687-cb149f4a8987 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:18.967741 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3aaeb7af-9d14-4b34-b687-cb149f4a8987 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:18.968192 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3aaeb7af-9d14-4b34-b687-cb149f4a8987 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:18.969249 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3aaeb7af-9d14-4b34-b687-cb149f4a8987 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:18.969704 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3aaeb7af-9d14-4b34-b687-cb149f4a8987 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:18.970125 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3aaeb7af-9d14-4b34-b687-cb149f4a8987 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:19.105318 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-2b643591-8177-4e25-9675-4dbff2072b4e tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7493d38d24493b3298ac37592ecd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c8a1db00944c59950120c030ab47e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:05:19.113011 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-2b643591-8177-4e25-9675-4dbff2072b4e tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] 10.222.0.48 "GET /compute/v2.1/servers/b2d65671-2e58-41ac-9aa1-245420900315" status: 200 len: 1319 microversion: 2.1 time: 0.204826 Aug 11 11:05:19.123781 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 106/218] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:05:18 2022] GET /compute/v2.1/servers/b2d65671-2e58-41ac-9aa1-245420900315 => generated 1319 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:05:19.135262 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-3aaeb7af-9d14-4b34-b687-cb149f4a8987 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:05:19.142761 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-3aaeb7af-9d14-4b34-b687-cb149f4a8987 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/7cfaa606-ef7e-4594-aaba-72be96386bd7" status: 200 len: 1520 microversion: 2.1 time: 0.190751 Aug 11 11:05:19.143325 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 113/219] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:05:18 2022] GET /compute/v2.1/servers/7cfaa606-ef7e-4594-aaba-72be96386bd7 => generated 1520 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:05:20.134510 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-fff66fa9-1cd4-4d95-9aa9-5982945c5b68 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:05:20.135022 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-fff66fa9-1cd4-4d95-9aa9-5982945c5b68 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] [instance: b2d65671-2e58-41ac-9aa1-245420900315] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:05:20.141517 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fff66fa9-1cd4-4d95-9aa9-5982945c5b68 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:20.141990 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fff66fa9-1cd4-4d95-9aa9-5982945c5b68 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:20.142415 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fff66fa9-1cd4-4d95-9aa9-5982945c5b68 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:20.143087 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fff66fa9-1cd4-4d95-9aa9-5982945c5b68 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:20.143529 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fff66fa9-1cd4-4d95-9aa9-5982945c5b68 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:20.143971 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fff66fa9-1cd4-4d95-9aa9-5982945c5b68 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:20.165027 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-0a4e70a3-534b-4b17-9f59-4d5cc3a5ef0d tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:05:20.165640 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-0a4e70a3-534b-4b17-9f59-4d5cc3a5ef0d tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 7cfaa606-ef7e-4594-aaba-72be96386bd7] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:05:20.174001 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0a4e70a3-534b-4b17-9f59-4d5cc3a5ef0d tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:20.174491 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0a4e70a3-534b-4b17-9f59-4d5cc3a5ef0d tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:20.174964 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0a4e70a3-534b-4b17-9f59-4d5cc3a5ef0d tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:20.175674 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0a4e70a3-534b-4b17-9f59-4d5cc3a5ef0d tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:20.176157 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0a4e70a3-534b-4b17-9f59-4d5cc3a5ef0d tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:20.176583 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0a4e70a3-534b-4b17-9f59-4d5cc3a5ef0d tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:20.352503 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-fff66fa9-1cd4-4d95-9aa9-5982945c5b68 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7493d38d24493b3298ac37592ecd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c8a1db00944c59950120c030ab47e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:05:20.356722 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-0a4e70a3-534b-4b17-9f59-4d5cc3a5ef0d tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:05:20.359840 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-fff66fa9-1cd4-4d95-9aa9-5982945c5b68 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] 10.222.0.48 "GET /compute/v2.1/servers/b2d65671-2e58-41ac-9aa1-245420900315" status: 200 len: 1319 microversion: 2.1 time: 0.229298 Aug 11 11:05:20.360412 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 107/220] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:05:20 2022] GET /compute/v2.1/servers/b2d65671-2e58-41ac-9aa1-245420900315 => generated 1319 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:05:20.364373 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-0a4e70a3-534b-4b17-9f59-4d5cc3a5ef0d tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/7cfaa606-ef7e-4594-aaba-72be96386bd7" status: 200 len: 1520 microversion: 2.1 time: 0.205296 Aug 11 11:05:20.364945 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 114/221] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:05:20 2022] GET /compute/v2.1/servers/7cfaa606-ef7e-4594-aaba-72be96386bd7 => generated 1520 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:05:21.380700 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-08e3122d-fc26-4662-a72e-e7b28bebd41b tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:05:21.381308 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-08e3122d-fc26-4662-a72e-e7b28bebd41b tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] [instance: b2d65671-2e58-41ac-9aa1-245420900315] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:05:21.383611 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:05:21.385015 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-756fdb81-8556-4213-9503-6e6a81d3c381 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:05:21.385627 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-756fdb81-8556-4213-9503-6e6a81d3c381 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 7cfaa606-ef7e-4594-aaba-72be96386bd7] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:05:21.389015 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-08e3122d-fc26-4662-a72e-e7b28bebd41b tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:21.396667 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-08e3122d-fc26-4662-a72e-e7b28bebd41b tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:21.396667 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-08e3122d-fc26-4662-a72e-e7b28bebd41b tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:21.396667 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-08e3122d-fc26-4662-a72e-e7b28bebd41b tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:21.396667 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-08e3122d-fc26-4662-a72e-e7b28bebd41b tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:21.396996 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-756fdb81-8556-4213-9503-6e6a81d3c381 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:21.397090 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-08e3122d-fc26-4662-a72e-e7b28bebd41b tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:21.397166 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-756fdb81-8556-4213-9503-6e6a81d3c381 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:21.397166 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-756fdb81-8556-4213-9503-6e6a81d3c381 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:21.397166 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-756fdb81-8556-4213-9503-6e6a81d3c381 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:21.397166 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-756fdb81-8556-4213-9503-6e6a81d3c381 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:21.397449 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-756fdb81-8556-4213-9503-6e6a81d3c381 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:21.584689 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-08e3122d-fc26-4662-a72e-e7b28bebd41b tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7493d38d24493b3298ac37592ecd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c8a1db00944c59950120c030ab47e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:05:21.588881 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-756fdb81-8556-4213-9503-6e6a81d3c381 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:05:21.595862 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-08e3122d-fc26-4662-a72e-e7b28bebd41b tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] 10.222.0.48 "GET /compute/v2.1/servers/b2d65671-2e58-41ac-9aa1-245420900315" status: 200 len: 1319 microversion: 2.1 time: 0.219355 Aug 11 11:05:21.596439 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 108/222] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:05:21 2022] GET /compute/v2.1/servers/b2d65671-2e58-41ac-9aa1-245420900315 => generated 1319 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:05:21.596707 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-756fdb81-8556-4213-9503-6e6a81d3c381 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/7cfaa606-ef7e-4594-aaba-72be96386bd7" status: 200 len: 1520 microversion: 2.1 time: 0.215472 Aug 11 11:05:21.597275 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 115/223] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:05:21 2022] GET /compute/v2.1/servers/7cfaa606-ef7e-4594-aaba-72be96386bd7 => generated 1520 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:05:22.617375 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-15c9b03a-641e-4006-9232-a1ac23ece7cb tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:05:22.620767 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-15c9b03a-641e-4006-9232-a1ac23ece7cb tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 7cfaa606-ef7e-4594-aaba-72be96386bd7] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:05:22.623926 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-6a465117-b61c-42fa-8749-3bd9d739479c tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:05:22.624543 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-6a465117-b61c-42fa-8749-3bd9d739479c tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] [instance: b2d65671-2e58-41ac-9aa1-245420900315] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:05:22.632476 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-15c9b03a-641e-4006-9232-a1ac23ece7cb tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:22.632971 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-15c9b03a-641e-4006-9232-a1ac23ece7cb tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:22.633409 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-15c9b03a-641e-4006-9232-a1ac23ece7cb tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:22.634106 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-15c9b03a-641e-4006-9232-a1ac23ece7cb tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:22.634559 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-15c9b03a-641e-4006-9232-a1ac23ece7cb tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:22.635031 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-15c9b03a-641e-4006-9232-a1ac23ece7cb tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:22.635547 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6a465117-b61c-42fa-8749-3bd9d739479c tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:22.636211 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6a465117-b61c-42fa-8749-3bd9d739479c tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:22.636663 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6a465117-b61c-42fa-8749-3bd9d739479c tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:22.637422 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6a465117-b61c-42fa-8749-3bd9d739479c tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:22.637798 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6a465117-b61c-42fa-8749-3bd9d739479c tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:22.638220 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6a465117-b61c-42fa-8749-3bd9d739479c tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:22.642887 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:05:22.852380 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-6a465117-b61c-42fa-8749-3bd9d739479c tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7493d38d24493b3298ac37592ecd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c8a1db00944c59950120c030ab47e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:05:22.856763 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-15c9b03a-641e-4006-9232-a1ac23ece7cb tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:05:22.860192 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-6a465117-b61c-42fa-8749-3bd9d739479c tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] 10.222.0.48 "GET /compute/v2.1/servers/b2d65671-2e58-41ac-9aa1-245420900315" status: 200 len: 1319 microversion: 2.1 time: 0.247432 Aug 11 11:05:22.861603 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 109/224] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:05:22 2022] GET /compute/v2.1/servers/b2d65671-2e58-41ac-9aa1-245420900315 => generated 1319 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:05:22.873911 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-15c9b03a-641e-4006-9232-a1ac23ece7cb tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/7cfaa606-ef7e-4594-aaba-72be96386bd7" status: 200 len: 1520 microversion: 2.1 time: 0.260091 Aug 11 11:05:22.874549 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 116/225] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:05:22 2022] GET /compute/v2.1/servers/7cfaa606-ef7e-4594-aaba-72be96386bd7 => generated 1520 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:05:23.881263 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-2089984f-d22a-4a79-a64a-e92ad9806a9f tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:05:23.881895 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-2089984f-d22a-4a79-a64a-e92ad9806a9f tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] [instance: b2d65671-2e58-41ac-9aa1-245420900315] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:05:23.888467 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2089984f-d22a-4a79-a64a-e92ad9806a9f tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:23.888951 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2089984f-d22a-4a79-a64a-e92ad9806a9f tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:23.889386 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2089984f-d22a-4a79-a64a-e92ad9806a9f tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:23.890071 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2089984f-d22a-4a79-a64a-e92ad9806a9f tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:23.890522 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2089984f-d22a-4a79-a64a-e92ad9806a9f tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:23.890944 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2089984f-d22a-4a79-a64a-e92ad9806a9f tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:23.894374 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-de3664c2-d348-4920-96c3-9e94bee88d37 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:05:23.894979 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-de3664c2-d348-4920-96c3-9e94bee88d37 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 7cfaa606-ef7e-4594-aaba-72be96386bd7] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:05:23.901204 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-de3664c2-d348-4920-96c3-9e94bee88d37 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:23.903264 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-de3664c2-d348-4920-96c3-9e94bee88d37 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:23.903264 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-de3664c2-d348-4920-96c3-9e94bee88d37 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:23.903264 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-de3664c2-d348-4920-96c3-9e94bee88d37 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:23.903264 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-de3664c2-d348-4920-96c3-9e94bee88d37 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:23.903748 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-de3664c2-d348-4920-96c3-9e94bee88d37 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:24.089533 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-2089984f-d22a-4a79-a64a-e92ad9806a9f tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7493d38d24493b3298ac37592ecd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c8a1db00944c59950120c030ab47e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:05:24.096091 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-de3664c2-d348-4920-96c3-9e94bee88d37 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:05:24.096965 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-2089984f-d22a-4a79-a64a-e92ad9806a9f tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] 10.222.0.48 "GET /compute/v2.1/servers/b2d65671-2e58-41ac-9aa1-245420900315" status: 200 len: 1319 microversion: 2.1 time: 0.219887 Aug 11 11:05:24.097542 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 110/226] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:05:23 2022] GET /compute/v2.1/servers/b2d65671-2e58-41ac-9aa1-245420900315 => generated 1319 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:05:24.101753 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=100 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:05:24.102631 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-2a9d1855-a768-408e-bfb0-e869903280c8 req-6cba61de-e332-4f7a-8acc-4af4516c0b73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2d65671-2e58-41ac-9aa1-245420900315", "name": "network-vif-plugged", "status": "completed", "tag": "f9bf133d-cd7d-427c-affe-dd52652cff0c"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:05:24.107053 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-de3664c2-d348-4920-96c3-9e94bee88d37 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/7cfaa606-ef7e-4594-aaba-72be96386bd7" status: 200 len: 1520 microversion: 2.1 time: 0.216476 Aug 11 11:05:24.107626 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 117/227] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:05:23 2022] GET /compute/v2.1/servers/7cfaa606-ef7e-4594-aaba-72be96386bd7 => generated 1520 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:05:24.112211 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-2a9d1855-a768-408e-bfb0-e869903280c8 req-6cba61de-e332-4f7a-8acc-4af4516c0b73 service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:24.112686 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-2a9d1855-a768-408e-bfb0-e869903280c8 req-6cba61de-e332-4f7a-8acc-4af4516c0b73 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:24.114428 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-2a9d1855-a768-408e-bfb0-e869903280c8 req-6cba61de-e332-4f7a-8acc-4af4516c0b73 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:24.124121 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-2a9d1855-a768-408e-bfb0-e869903280c8 req-6cba61de-e332-4f7a-8acc-4af4516c0b73 service nova] Creating event network-vif-plugged:f9bf133d-cd7d-427c-affe-dd52652cff0c for instance b2d65671-2e58-41ac-9aa1-245420900315 on hv-cinder-82002 Aug 11 11:05:24.129198 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-2a9d1855-a768-408e-bfb0-e869903280c8 req-6cba61de-e332-4f7a-8acc-4af4516c0b73 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030572 Aug 11 11:05:24.129770 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 111/228] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:05:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:05:25.120071 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-a313140c-0237-4704-bb1f-648539aad479 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:05:25.120762 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-a313140c-0237-4704-bb1f-648539aad479 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] [instance: b2d65671-2e58-41ac-9aa1-245420900315] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:05:25.128208 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a313140c-0237-4704-bb1f-648539aad479 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:25.129066 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a313140c-0237-4704-bb1f-648539aad479 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:25.129726 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a313140c-0237-4704-bb1f-648539aad479 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:25.131321 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a313140c-0237-4704-bb1f-648539aad479 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:25.132480 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a313140c-0237-4704-bb1f-648539aad479 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:25.133141 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a313140c-0237-4704-bb1f-648539aad479 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:25.135416 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-3b984e53-ec97-45be-8cf8-03b5a0af0eb6 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:05:25.136903 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-3b984e53-ec97-45be-8cf8-03b5a0af0eb6 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 7cfaa606-ef7e-4594-aaba-72be96386bd7] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:05:25.145096 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3b984e53-ec97-45be-8cf8-03b5a0af0eb6 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:25.145819 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3b984e53-ec97-45be-8cf8-03b5a0af0eb6 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:25.146487 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3b984e53-ec97-45be-8cf8-03b5a0af0eb6 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:25.147592 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3b984e53-ec97-45be-8cf8-03b5a0af0eb6 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:25.148280 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3b984e53-ec97-45be-8cf8-03b5a0af0eb6 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:25.149278 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3b984e53-ec97-45be-8cf8-03b5a0af0eb6 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:25.453122 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-3b984e53-ec97-45be-8cf8-03b5a0af0eb6 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:05:25.461974 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-3b984e53-ec97-45be-8cf8-03b5a0af0eb6 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/7cfaa606-ef7e-4594-aaba-72be96386bd7" status: 200 len: 1520 microversion: 2.1 time: 0.331707 Aug 11 11:05:25.475233 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 112/229] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:05:25 2022] GET /compute/v2.1/servers/7cfaa606-ef7e-4594-aaba-72be96386bd7 => generated 1520 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:05:25.475438 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-a313140c-0237-4704-bb1f-648539aad479 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7493d38d24493b3298ac37592ecd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c8a1db00944c59950120c030ab47e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:05:25.475438 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-a313140c-0237-4704-bb1f-648539aad479 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] 10.222.0.48 "GET /compute/v2.1/servers/b2d65671-2e58-41ac-9aa1-245420900315" status: 200 len: 1319 microversion: 2.1 time: 0.358709 Aug 11 11:05:25.477044 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 118/230] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:05:25 2022] GET /compute/v2.1/servers/b2d65671-2e58-41ac-9aa1-245420900315 => generated 1319 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:05:26.482825 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-d3124a27-fd50-4d6a-8f6d-4d451c107301 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:05:26.483573 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-d3124a27-fd50-4d6a-8f6d-4d451c107301 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 7cfaa606-ef7e-4594-aaba-72be96386bd7] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:05:26.490422 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d3124a27-fd50-4d6a-8f6d-4d451c107301 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:26.490901 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d3124a27-fd50-4d6a-8f6d-4d451c107301 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:26.491330 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d3124a27-fd50-4d6a-8f6d-4d451c107301 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:26.492099 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d3124a27-fd50-4d6a-8f6d-4d451c107301 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:26.492557 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d3124a27-fd50-4d6a-8f6d-4d451c107301 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:26.492983 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d3124a27-fd50-4d6a-8f6d-4d451c107301 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:26.498616 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-8c5453f4-cf1d-4bc6-83f6-cc71e93ce573 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:05:26.510945 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-8c5453f4-cf1d-4bc6-83f6-cc71e93ce573 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] [instance: b2d65671-2e58-41ac-9aa1-245420900315] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:05:26.510945 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8c5453f4-cf1d-4bc6-83f6-cc71e93ce573 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:26.510945 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8c5453f4-cf1d-4bc6-83f6-cc71e93ce573 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:26.510945 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8c5453f4-cf1d-4bc6-83f6-cc71e93ce573 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:26.512095 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8c5453f4-cf1d-4bc6-83f6-cc71e93ce573 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:26.512095 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8c5453f4-cf1d-4bc6-83f6-cc71e93ce573 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:26.512095 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8c5453f4-cf1d-4bc6-83f6-cc71e93ce573 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:26.706560 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-d3124a27-fd50-4d6a-8f6d-4d451c107301 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:05:26.713855 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-8c5453f4-cf1d-4bc6-83f6-cc71e93ce573 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7493d38d24493b3298ac37592ecd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c8a1db00944c59950120c030ab47e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:05:26.714156 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-d3124a27-fd50-4d6a-8f6d-4d451c107301 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/7cfaa606-ef7e-4594-aaba-72be96386bd7" status: 200 len: 1520 microversion: 2.1 time: 0.235238 Aug 11 11:05:26.714731 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 113/231] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:05:26 2022] GET /compute/v2.1/servers/7cfaa606-ef7e-4594-aaba-72be96386bd7 => generated 1520 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:05:26.721458 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-8c5453f4-cf1d-4bc6-83f6-cc71e93ce573 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] 10.222.0.48 "GET /compute/v2.1/servers/b2d65671-2e58-41ac-9aa1-245420900315" status: 200 len: 1319 microversion: 2.1 time: 0.226874 Aug 11 11:05:26.722175 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 119/232] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:05:26 2022] GET /compute/v2.1/servers/b2d65671-2e58-41ac-9aa1-245420900315 => generated 1319 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:05:27.735501 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-eb0a0879-42a2-4991-b26b-512f3ec5be32 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:05:27.736125 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-eb0a0879-42a2-4991-b26b-512f3ec5be32 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 7cfaa606-ef7e-4594-aaba-72be96386bd7] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:05:27.742309 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-04f1e0f8-47c8-40b4-b497-7ae8cacf5cdb tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:05:27.742922 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-04f1e0f8-47c8-40b4-b497-7ae8cacf5cdb tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] [instance: b2d65671-2e58-41ac-9aa1-245420900315] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:05:27.743059 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-eb0a0879-42a2-4991-b26b-512f3ec5be32 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:27.743432 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-eb0a0879-42a2-4991-b26b-512f3ec5be32 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:27.743895 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-eb0a0879-42a2-4991-b26b-512f3ec5be32 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:27.744577 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-eb0a0879-42a2-4991-b26b-512f3ec5be32 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:27.745021 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-eb0a0879-42a2-4991-b26b-512f3ec5be32 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:27.745434 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-eb0a0879-42a2-4991-b26b-512f3ec5be32 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:27.748835 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-04f1e0f8-47c8-40b4-b497-7ae8cacf5cdb tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:27.749322 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-04f1e0f8-47c8-40b4-b497-7ae8cacf5cdb tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:27.749757 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-04f1e0f8-47c8-40b4-b497-7ae8cacf5cdb tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:27.750447 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-04f1e0f8-47c8-40b4-b497-7ae8cacf5cdb tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:27.750901 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-04f1e0f8-47c8-40b4-b497-7ae8cacf5cdb tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:27.751326 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-04f1e0f8-47c8-40b4-b497-7ae8cacf5cdb tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:27.945765 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-eb0a0879-42a2-4991-b26b-512f3ec5be32 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:05:27.948654 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-04f1e0f8-47c8-40b4-b497-7ae8cacf5cdb tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7493d38d24493b3298ac37592ecd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c8a1db00944c59950120c030ab47e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:05:27.955734 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-eb0a0879-42a2-4991-b26b-512f3ec5be32 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/7cfaa606-ef7e-4594-aaba-72be96386bd7" status: 200 len: 1520 microversion: 2.1 time: 0.224394 Aug 11 11:05:27.956338 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 114/233] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:05:27 2022] GET /compute/v2.1/servers/7cfaa606-ef7e-4594-aaba-72be96386bd7 => generated 1520 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:05:27.956445 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-04f1e0f8-47c8-40b4-b497-7ae8cacf5cdb tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] 10.222.0.48 "GET /compute/v2.1/servers/b2d65671-2e58-41ac-9aa1-245420900315" status: 200 len: 1319 microversion: 2.1 time: 0.217934 Aug 11 11:05:27.956950 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 120/234] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:05:27 2022] GET /compute/v2.1/servers/b2d65671-2e58-41ac-9aa1-245420900315 => generated 1319 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:05:28.976954 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-920c1cc4-3648-41de-9a91-0bf63b5fc977 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:05:28.977566 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-920c1cc4-3648-41de-9a91-0bf63b5fc977 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] [instance: b2d65671-2e58-41ac-9aa1-245420900315] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:05:28.978074 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-cb9f4875-2ddb-4158-9e72-9af2ea1be1d3 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:05:28.978678 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-cb9f4875-2ddb-4158-9e72-9af2ea1be1d3 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 7cfaa606-ef7e-4594-aaba-72be96386bd7] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:05:28.984310 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-920c1cc4-3648-41de-9a91-0bf63b5fc977 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:28.984701 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cb9f4875-2ddb-4158-9e72-9af2ea1be1d3 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:28.984814 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-920c1cc4-3648-41de-9a91-0bf63b5fc977 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:28.985175 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cb9f4875-2ddb-4158-9e72-9af2ea1be1d3 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:28.985284 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-920c1cc4-3648-41de-9a91-0bf63b5fc977 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:28.985604 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cb9f4875-2ddb-4158-9e72-9af2ea1be1d3 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:28.985877 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-920c1cc4-3648-41de-9a91-0bf63b5fc977 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:28.986275 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cb9f4875-2ddb-4158-9e72-9af2ea1be1d3 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:28.986366 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-920c1cc4-3648-41de-9a91-0bf63b5fc977 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:28.986726 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cb9f4875-2ddb-4158-9e72-9af2ea1be1d3 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:28.986843 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-920c1cc4-3648-41de-9a91-0bf63b5fc977 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:28.987140 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cb9f4875-2ddb-4158-9e72-9af2ea1be1d3 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:29.179088 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-cb9f4875-2ddb-4158-9e72-9af2ea1be1d3 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:05:29.183455 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-920c1cc4-3648-41de-9a91-0bf63b5fc977 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7493d38d24493b3298ac37592ecd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c8a1db00944c59950120c030ab47e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:05:29.187118 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-cb9f4875-2ddb-4158-9e72-9af2ea1be1d3 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/7cfaa606-ef7e-4594-aaba-72be96386bd7" status: 200 len: 1520 microversion: 2.1 time: 0.212745 Aug 11 11:05:29.187701 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 121/235] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:05:28 2022] GET /compute/v2.1/servers/7cfaa606-ef7e-4594-aaba-72be96386bd7 => generated 1520 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:05:29.191291 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-920c1cc4-3648-41de-9a91-0bf63b5fc977 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] 10.222.0.48 "GET /compute/v2.1/servers/b2d65671-2e58-41ac-9aa1-245420900315" status: 200 len: 1319 microversion: 2.1 time: 0.218168 Aug 11 11:05:29.192529 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 115/236] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:05:28 2022] GET /compute/v2.1/servers/b2d65671-2e58-41ac-9aa1-245420900315 => generated 1319 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:05:30.208669 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-d80255d8-c2ad-4716-b50c-eda80a1d2b58 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:05:30.209282 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-d80255d8-c2ad-4716-b50c-eda80a1d2b58 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 7cfaa606-ef7e-4594-aaba-72be96386bd7] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:05:30.213196 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-01639fbb-e8ad-4f26-aff6-d103cf5f6a1b tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:05:30.213797 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-01639fbb-e8ad-4f26-aff6-d103cf5f6a1b tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] [instance: b2d65671-2e58-41ac-9aa1-245420900315] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:05:30.215451 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d80255d8-c2ad-4716-b50c-eda80a1d2b58 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:30.215979 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d80255d8-c2ad-4716-b50c-eda80a1d2b58 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:30.216412 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d80255d8-c2ad-4716-b50c-eda80a1d2b58 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:30.217102 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d80255d8-c2ad-4716-b50c-eda80a1d2b58 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:30.217551 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d80255d8-c2ad-4716-b50c-eda80a1d2b58 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:30.218032 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d80255d8-c2ad-4716-b50c-eda80a1d2b58 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:30.221026 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-01639fbb-e8ad-4f26-aff6-d103cf5f6a1b tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:30.221509 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-01639fbb-e8ad-4f26-aff6-d103cf5f6a1b tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:30.221942 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-01639fbb-e8ad-4f26-aff6-d103cf5f6a1b tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:30.222618 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-01639fbb-e8ad-4f26-aff6-d103cf5f6a1b tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:30.223237 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-01639fbb-e8ad-4f26-aff6-d103cf5f6a1b tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:30.224688 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-01639fbb-e8ad-4f26-aff6-d103cf5f6a1b tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:30.437152 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d80255d8-c2ad-4716-b50c-eda80a1d2b58 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:05:30.445673 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-d80255d8-c2ad-4716-b50c-eda80a1d2b58 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/7cfaa606-ef7e-4594-aaba-72be96386bd7" status: 200 len: 1500 microversion: 2.1 time: 0.241445 Aug 11 11:05:30.446507 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 122/237] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:05:30 2022] GET /compute/v2.1/servers/7cfaa606-ef7e-4594-aaba-72be96386bd7 => generated 1500 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:05:30.449013 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-01639fbb-e8ad-4f26-aff6-d103cf5f6a1b tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7493d38d24493b3298ac37592ecd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c8a1db00944c59950120c030ab47e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:05:30.456629 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-01639fbb-e8ad-4f26-aff6-d103cf5f6a1b tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] 10.222.0.48 "GET /compute/v2.1/servers/b2d65671-2e58-41ac-9aa1-245420900315" status: 200 len: 1319 microversion: 2.1 time: 0.247121 Aug 11 11:05:30.457428 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 116/238] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:05:30 2022] GET /compute/v2.1/servers/b2d65671-2e58-41ac-9aa1-245420900315 => generated 1319 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:05:30.472672 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-4f1895c7-bccc-4b77-9451-b38ce3d86805 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "87b8a3cd-af57-46a3-b3bc-3750866156a9"}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:05:30.475051 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-4f1895c7-bccc-4b77-9451-b38ce3d86805 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 7cfaa606-ef7e-4594-aaba-72be96386bd7] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:05:30.481421 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4f1895c7-bccc-4b77-9451-b38ce3d86805 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:30.481910 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4f1895c7-bccc-4b77-9451-b38ce3d86805 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:30.482342 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4f1895c7-bccc-4b77-9451-b38ce3d86805 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:30.483061 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4f1895c7-bccc-4b77-9451-b38ce3d86805 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:30.483540 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4f1895c7-bccc-4b77-9451-b38ce3d86805 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:30.483984 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4f1895c7-bccc-4b77-9451-b38ce3d86805 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:30.510107 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.wsgi [None req-4f1895c7-bccc-4b77-9451-b38ce3d86805 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] HTTP exception thrown: Cannot 'attach_volume' instance 7cfaa606-ef7e-4594-aaba-72be96386bd7 while it is in vm_state rescued Aug 11 11:05:30.511899 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-4f1895c7-bccc-4b77-9451-b38ce3d86805 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Request method failure captured: Aug 11 11:05:30.511899 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: request: POST /compute/v2.1/servers/7cfaa606-ef7e-4594-aaba-72be96386bd7/os-volume_attachments HTTP/1.1 Aug 11 11:05:30.511899 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Accept: application/json Aug 11 11:05:30.511899 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Accept-Encoding: identity Aug 11 11:05:30.511899 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Connection: close Aug 11 11:05:30.511899 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Content-Length: 74 Aug 11 11:05:30.511899 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Content-Type: application/json Aug 11 11:05:30.511899 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Host: 10.222.0.48 Aug 11 11:05:30.511899 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Openstack-System-Scope: None Aug 11 11:05:30.511899 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: User-Agent: python-urllib3/1.26.11 Aug 11 11:05:30.511899 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Auth-Token: gAAAAABi9OIZrQLD9wcn33oOAILRLRgizejVjH27hxki3e7YaqpWc9w5AB6twcQbo6ujH2ticAWA98YJt2oEA_0zpX3GqgJkSqqHfHltxhU9T4SgJ_YQxUiy9cMGURf0wSoT5Vg71mc-C9U7FKhPy_DOheOZskafHmoddANNVZO-sZBS_1qYvI4 Aug 11 11:05:30.511899 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Domain-Id: None Aug 11 11:05:30.511899 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Domain-Name: None Aug 11 11:05:30.511899 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Identity-Status: Confirmed Aug 11 11:05:30.511899 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Is-Admin-Project: True Aug 11 11:05:30.511899 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Domain-Id: default Aug 11 11:05:30.511899 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Domain-Name: Default Aug 11 11:05:30.511899 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Id: e8751d4bd74240db9b57b7e9f788df94 Aug 11 11:05:30.511899 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1157402601 Aug 11 11:05:30.511899 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Role: reader,member Aug 11 11:05:30.511899 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Roles: reader,member Aug 11 11:05:30.513172 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e8751d4bd74240db9b57b7e9f788df94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e8751d4bd74240db9b57b7e9f788df94"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e8751d4bd74240db9b57b7e9f788df94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e8751d4bd74240db9b57b7e9f788df94", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] Aug 11 11:05:30.513172 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1157402601 Aug 11 11:05:30.513172 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Tenant-Id: e8751d4bd74240db9b57b7e9f788df94 Aug 11 11:05:30.513172 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1157402601 Aug 11 11:05:30.513172 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User: tempest-ServerRescueNegativeTestJSON-1157402601-project Aug 11 11:05:30.513172 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Domain-Id: default Aug 11 11:05:30.513172 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Domain-Name: Default Aug 11 11:05:30.513172 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Id: 684d59041e82466d8aad6d2964842bf5 Aug 11 11:05:30.513172 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1157402601-project Aug 11 11:05:30.513172 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Aug 11 11:05:30.513172 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: {"volumeAttachment": {"volumeId": "87b8a3cd-af57-46a3-b3bc-3750866156a9"}} Aug 11 11:05:30.513172 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: method: > Aug 11 11:05:30.513984 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: exception: Cannot 'attach_volume' instance 7cfaa606-ef7e-4594-aaba-72be96386bd7 while it is in vm_state rescued Aug 11 11:05:30.513984 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: action_args: {'server_id': '7cfaa606-ef7e-4594-aaba-72be96386bd7', 'body': {'volumeAttachment': {'volumeId': '87b8a3cd-af57-46a3-b3bc-3750866156a9'}}} Aug 11 11:05:30.513984 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 11:05:30.513984 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:05:30.513984 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 11 11:05:30.513984 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 11 11:05:30.513984 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 11 11:05:30.513984 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 11 11:05:30.513984 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 11 11:05:30.513984 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 11 11:05:30.513984 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7cfaa606-ef7e-4594-aaba-72be96386bd7 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 11 11:05:30.513984 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:05:30.513984 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:05:30.513984 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:05:30.513984 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:05:30.513984 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:05:30.513984 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:05:30.513984 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 11:05:30.513984 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 11:05:30.515586 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 11:05:30.515586 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 11:05:30.515586 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 11 11:05:30.515586 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 11 11:05:30.515586 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 11 11:05:30.515586 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 11 11:05:30.515586 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 11 11:05:30.515586 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 11 11:05:30.515586 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 11 11:05:30.515586 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 11 11:05:30.515586 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 11 11:05:30.515586 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 11 11:05:30.515586 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 7cfaa606-ef7e-4594-aaba-72be96386bd7 while it is in vm_state rescued Aug 11 11:05:30.515586 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:05:30.515586 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:05:30.515586 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:05:30.515586 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:05:30.515586 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:05:30.515586 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:05:30.518675 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 11:05:30.518675 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 11:05:30.518675 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 7cfaa606-ef7e-4594-aaba-72be96386bd7 while it is in vm_state rescued Aug 11 11:05:30.518675 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:05:30.518675 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-4f1895c7-bccc-4b77-9451-b38ce3d86805 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Returning 409 to user: Cannot 'attach_volume' instance 7cfaa606-ef7e-4594-aaba-72be96386bd7 while it is in vm_state rescued {{(pid=121232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 11:05:30.518675 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-4f1895c7-bccc-4b77-9451-b38ce3d86805 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "POST /compute/v2.1/servers/7cfaa606-ef7e-4594-aaba-72be96386bd7/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.044705 Aug 11 11:05:30.518675 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 123/239] 10.222.0.48 () {60 vars in 1323 bytes} [Thu Aug 11 11:05:30 2022] POST /compute/v2.1/servers/7cfaa606-ef7e-4594-aaba-72be96386bd7/os-volume_attachments => generated 152 bytes in 46 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 11 11:05:30.525354 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-76126df8-65f3-4d46-b1c4-ecc8f5db5539 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:05:30.525889 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-76126df8-65f3-4d46-b1c4-ecc8f5db5539 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 7cfaa606-ef7e-4594-aaba-72be96386bd7] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:05:30.532704 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-76126df8-65f3-4d46-b1c4-ecc8f5db5539 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:30.533433 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-76126df8-65f3-4d46-b1c4-ecc8f5db5539 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:30.534073 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-76126df8-65f3-4d46-b1c4-ecc8f5db5539 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:30.535095 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-76126df8-65f3-4d46-b1c4-ecc8f5db5539 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:30.535799 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-76126df8-65f3-4d46-b1c4-ecc8f5db5539 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:30.536400 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-76126df8-65f3-4d46-b1c4-ecc8f5db5539 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:30.773981 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-76126df8-65f3-4d46-b1c4-ecc8f5db5539 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "POST /compute/v2.1/servers/7cfaa606-ef7e-4594-aaba-72be96386bd7/action" status: 202 len: 0 microversion: 2.1 time: 0.252364 Aug 11 11:05:30.774618 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 117/240] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Aug 11 11:05:30 2022] POST /compute/v2.1/servers/7cfaa606-ef7e-4594-aaba-72be96386bd7/action => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 11:05:30.783301 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-35e11c72-b440-4d74-bc54-3260d7094907 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:05:30.784012 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-35e11c72-b440-4d74-bc54-3260d7094907 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 7cfaa606-ef7e-4594-aaba-72be96386bd7] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:05:30.789932 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-35e11c72-b440-4d74-bc54-3260d7094907 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:30.790393 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-35e11c72-b440-4d74-bc54-3260d7094907 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:30.790816 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-35e11c72-b440-4d74-bc54-3260d7094907 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:30.791497 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-35e11c72-b440-4d74-bc54-3260d7094907 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:30.791976 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-35e11c72-b440-4d74-bc54-3260d7094907 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:30.792393 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-35e11c72-b440-4d74-bc54-3260d7094907 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:31.119101 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-35e11c72-b440-4d74-bc54-3260d7094907 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:05:31.127108 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-35e11c72-b440-4d74-bc54-3260d7094907 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/7cfaa606-ef7e-4594-aaba-72be96386bd7" status: 200 len: 1508 microversion: 2.1 time: 0.348162 Aug 11 11:05:31.127670 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 124/241] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:05:30 2022] GET /compute/v2.1/servers/7cfaa606-ef7e-4594-aaba-72be96386bd7 => generated 1508 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:05:31.271387 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-e02bde6b-f7aa-4775-bb9e-c0ded357fad8 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:05:31.272042 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-e02bde6b-f7aa-4775-bb9e-c0ded357fad8 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:05:31.279876 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e02bde6b-f7aa-4775-bb9e-c0ded357fad8 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:31.280366 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e02bde6b-f7aa-4775-bb9e-c0ded357fad8 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:31.280794 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e02bde6b-f7aa-4775-bb9e-c0ded357fad8 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:31.281485 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e02bde6b-f7aa-4775-bb9e-c0ded357fad8 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:31.281937 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e02bde6b-f7aa-4775-bb9e-c0ded357fad8 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:31.282354 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e02bde6b-f7aa-4775-bb9e-c0ded357fad8 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:31.311172 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-e02bde6b-f7aa-4775-bb9e-c0ded357fad8 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935/ips" status: 200 len: 147 microversion: 2.1 time: 0.045926 Aug 11 11:05:31.318106 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 118/242] 10.222.0.48 () {58 vars in 1248 bytes} [Thu Aug 11 11:05:31 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935/ips => generated 147 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:05:31.484806 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-99f01eba-2843-439b-a9a1-bc771869aff7 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:05:31.485424 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-99f01eba-2843-439b-a9a1-bc771869aff7 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] [instance: b2d65671-2e58-41ac-9aa1-245420900315] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:05:31.491905 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-99f01eba-2843-439b-a9a1-bc771869aff7 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:31.492389 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-99f01eba-2843-439b-a9a1-bc771869aff7 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:31.492998 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-99f01eba-2843-439b-a9a1-bc771869aff7 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:31.493713 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-99f01eba-2843-439b-a9a1-bc771869aff7 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:31.494164 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-99f01eba-2843-439b-a9a1-bc771869aff7 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:31.494578 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-99f01eba-2843-439b-a9a1-bc771869aff7 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:31.738791 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-99f01eba-2843-439b-a9a1-bc771869aff7 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7493d38d24493b3298ac37592ecd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c8a1db00944c59950120c030ab47e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:05:31.749530 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-99f01eba-2843-439b-a9a1-bc771869aff7 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] 10.222.0.48 "GET /compute/v2.1/servers/b2d65671-2e58-41ac-9aa1-245420900315" status: 200 len: 1508 microversion: 2.1 time: 0.268446 Aug 11 11:05:31.760385 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 125/243] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:05:31 2022] GET /compute/v2.1/servers/b2d65671-2e58-41ac-9aa1-245420900315 => generated 1508 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:05:32.148929 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-b2943e21-3d79-4cf7-9da4-26400c39d960 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:05:32.150330 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-b2943e21-3d79-4cf7-9da4-26400c39d960 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 7cfaa606-ef7e-4594-aaba-72be96386bd7] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:05:32.157959 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b2943e21-3d79-4cf7-9da4-26400c39d960 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:32.158444 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b2943e21-3d79-4cf7-9da4-26400c39d960 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:32.159182 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b2943e21-3d79-4cf7-9da4-26400c39d960 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:32.160397 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b2943e21-3d79-4cf7-9da4-26400c39d960 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:32.161518 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b2943e21-3d79-4cf7-9da4-26400c39d960 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:32.162280 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b2943e21-3d79-4cf7-9da4-26400c39d960 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:32.314661 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-b2943e21-3d79-4cf7-9da4-26400c39d960 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:05:32.322234 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-b2943e21-3d79-4cf7-9da4-26400c39d960 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/7cfaa606-ef7e-4594-aaba-72be96386bd7" status: 200 len: 1508 microversion: 2.1 time: 0.178474 Aug 11 11:05:32.322804 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 119/244] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:05:32 2022] GET /compute/v2.1/servers/7cfaa606-ef7e-4594-aaba-72be96386bd7 => generated 1508 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:05:33.343336 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-e964d40d-4bd0-4b55-bddc-f848ea8d7582 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:05:33.344004 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-e964d40d-4bd0-4b55-bddc-f848ea8d7582 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 7cfaa606-ef7e-4594-aaba-72be96386bd7] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:05:33.350079 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e964d40d-4bd0-4b55-bddc-f848ea8d7582 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:33.350558 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e964d40d-4bd0-4b55-bddc-f848ea8d7582 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:33.350985 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e964d40d-4bd0-4b55-bddc-f848ea8d7582 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:33.351661 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e964d40d-4bd0-4b55-bddc-f848ea8d7582 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:33.352148 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e964d40d-4bd0-4b55-bddc-f848ea8d7582 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:33.354910 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e964d40d-4bd0-4b55-bddc-f848ea8d7582 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:33.492789 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-e964d40d-4bd0-4b55-bddc-f848ea8d7582 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:05:33.501038 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-e964d40d-4bd0-4b55-bddc-f848ea8d7582 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/7cfaa606-ef7e-4594-aaba-72be96386bd7" status: 200 len: 1508 microversion: 2.1 time: 0.161658 Aug 11 11:05:33.501614 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 126/245] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:05:33 2022] GET /compute/v2.1/servers/7cfaa606-ef7e-4594-aaba-72be96386bd7 => generated 1508 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:05:34.521900 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-69838a1b-b082-45d6-b581-44f130de8e08 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:05:34.522502 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-69838a1b-b082-45d6-b581-44f130de8e08 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 7cfaa606-ef7e-4594-aaba-72be96386bd7] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:05:34.528946 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-69838a1b-b082-45d6-b581-44f130de8e08 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:34.529417 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-69838a1b-b082-45d6-b581-44f130de8e08 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:34.529842 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-69838a1b-b082-45d6-b581-44f130de8e08 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:34.530526 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-69838a1b-b082-45d6-b581-44f130de8e08 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:34.530971 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-69838a1b-b082-45d6-b581-44f130de8e08 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:34.531665 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-69838a1b-b082-45d6-b581-44f130de8e08 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:34.663485 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-69838a1b-b082-45d6-b581-44f130de8e08 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:05:34.670941 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-69838a1b-b082-45d6-b581-44f130de8e08 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/7cfaa606-ef7e-4594-aaba-72be96386bd7" status: 200 len: 1508 microversion: 2.1 time: 0.152817 Aug 11 11:05:34.671543 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 120/246] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:05:34 2022] GET /compute/v2.1/servers/7cfaa606-ef7e-4594-aaba-72be96386bd7 => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:05:35.691211 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-bc91d942-510f-46ae-a878-12b0787594d9 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:05:35.691895 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-bc91d942-510f-46ae-a878-12b0787594d9 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 7cfaa606-ef7e-4594-aaba-72be96386bd7] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:05:35.697913 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bc91d942-510f-46ae-a878-12b0787594d9 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:35.698398 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bc91d942-510f-46ae-a878-12b0787594d9 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:35.698832 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bc91d942-510f-46ae-a878-12b0787594d9 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:35.699515 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bc91d942-510f-46ae-a878-12b0787594d9 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:35.700006 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bc91d942-510f-46ae-a878-12b0787594d9 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:35.700431 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bc91d942-510f-46ae-a878-12b0787594d9 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:35.828217 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-bc91d942-510f-46ae-a878-12b0787594d9 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:05:35.836496 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-bc91d942-510f-46ae-a878-12b0787594d9 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/7cfaa606-ef7e-4594-aaba-72be96386bd7" status: 200 len: 1508 microversion: 2.1 time: 0.149231 Aug 11 11:05:35.837313 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 127/247] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:05:35 2022] GET /compute/v2.1/servers/7cfaa606-ef7e-4594-aaba-72be96386bd7 => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:05:36.858600 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-051603ca-f77a-4666-94a5-c5fe65827327 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:05:36.859140 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-051603ca-f77a-4666-94a5-c5fe65827327 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 7cfaa606-ef7e-4594-aaba-72be96386bd7] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:05:36.866305 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-051603ca-f77a-4666-94a5-c5fe65827327 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:36.866788 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-051603ca-f77a-4666-94a5-c5fe65827327 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:36.867218 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-051603ca-f77a-4666-94a5-c5fe65827327 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:36.868002 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-051603ca-f77a-4666-94a5-c5fe65827327 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:36.868452 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-051603ca-f77a-4666-94a5-c5fe65827327 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:36.868902 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-051603ca-f77a-4666-94a5-c5fe65827327 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:37.003182 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-051603ca-f77a-4666-94a5-c5fe65827327 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:05:37.011249 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-051603ca-f77a-4666-94a5-c5fe65827327 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/7cfaa606-ef7e-4594-aaba-72be96386bd7" status: 200 len: 1508 microversion: 2.1 time: 0.156829 Aug 11 11:05:37.011935 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 121/248] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:05:36 2022] GET /compute/v2.1/servers/7cfaa606-ef7e-4594-aaba-72be96386bd7 => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:05:37.677398 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-b2a0795e-f4d2-4f32-b5c5-b0bc3ce7be9e tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "71b44e35-b32b-4eb8-ba2c-dc2e3b55fb85"}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:05:37.679781 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-b2a0795e-f4d2-4f32-b5c5-b0bc3ce7be9e tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:05:37.685994 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b2a0795e-f4d2-4f32-b5c5-b0bc3ce7be9e tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:37.686472 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b2a0795e-f4d2-4f32-b5c5-b0bc3ce7be9e tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:37.686901 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b2a0795e-f4d2-4f32-b5c5-b0bc3ce7be9e tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:37.687578 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b2a0795e-f4d2-4f32-b5c5-b0bc3ce7be9e tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:37.688059 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b2a0795e-f4d2-4f32-b5c5-b0bc3ce7be9e tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:37.688542 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b2a0795e-f4d2-4f32-b5c5-b0bc3ce7be9e tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:38.033128 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-e8aac4d9-6e54-4e59-a36a-f9ba1c6648fe tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:05:38.033740 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-e8aac4d9-6e54-4e59-a36a-f9ba1c6648fe tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 7cfaa606-ef7e-4594-aaba-72be96386bd7] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:05:38.040643 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e8aac4d9-6e54-4e59-a36a-f9ba1c6648fe tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:38.041107 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e8aac4d9-6e54-4e59-a36a-f9ba1c6648fe tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:38.041534 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e8aac4d9-6e54-4e59-a36a-f9ba1c6648fe tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:38.042274 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e8aac4d9-6e54-4e59-a36a-f9ba1c6648fe tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:38.042785 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e8aac4d9-6e54-4e59-a36a-f9ba1c6648fe tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:38.043187 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e8aac4d9-6e54-4e59-a36a-f9ba1c6648fe tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:38.220661 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-e8aac4d9-6e54-4e59-a36a-f9ba1c6648fe tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:05:38.229431 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-e8aac4d9-6e54-4e59-a36a-f9ba1c6648fe tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/7cfaa606-ef7e-4594-aaba-72be96386bd7" status: 200 len: 1508 microversion: 2.1 time: 0.200337 Aug 11 11:05:38.230828 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 122/249] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:05:38 2022] GET /compute/v2.1/servers/7cfaa606-ef7e-4594-aaba-72be96386bd7 => generated 1508 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:05:38.853767 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-b2a0795e-f4d2-4f32-b5c5-b0bc3ce7be9e tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "POST /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.180091 Aug 11 11:05:38.855376 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 128/250] 10.222.0.48 () {60 vars in 1323 bytes} [Thu Aug 11 11:05:37 2022] POST /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935/os-volume_attachments => generated 194 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:05:39.250693 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-f0bbceb9-028b-45fb-97b7-c036aae113d6 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:05:39.251380 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-f0bbceb9-028b-45fb-97b7-c036aae113d6 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 7cfaa606-ef7e-4594-aaba-72be96386bd7] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:05:39.257855 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f0bbceb9-028b-45fb-97b7-c036aae113d6 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:39.258484 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f0bbceb9-028b-45fb-97b7-c036aae113d6 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:39.258971 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f0bbceb9-028b-45fb-97b7-c036aae113d6 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:39.259714 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f0bbceb9-028b-45fb-97b7-c036aae113d6 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:39.260138 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f0bbceb9-028b-45fb-97b7-c036aae113d6 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:39.260553 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f0bbceb9-028b-45fb-97b7-c036aae113d6 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:39.399620 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-f0bbceb9-028b-45fb-97b7-c036aae113d6 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:05:39.407756 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-f0bbceb9-028b-45fb-97b7-c036aae113d6 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/7cfaa606-ef7e-4594-aaba-72be96386bd7" status: 200 len: 1514 microversion: 2.1 time: 0.160915 Aug 11 11:05:39.411380 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 123/251] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:05:39 2022] GET /compute/v2.1/servers/7cfaa606-ef7e-4594-aaba-72be96386bd7 => generated 1514 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:05:43.528690 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-c4e9ac21-244b-4f0c-b0b5-fa3d5b6c1e73 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:05:43.530164 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-c4e9ac21-244b-4f0c-b0b5-fa3d5b6c1e73 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:05:43.532247 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_api:SELECT=44 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:05:43.538638 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c4e9ac21-244b-4f0c-b0b5-fa3d5b6c1e73 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:43.539128 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c4e9ac21-244b-4f0c-b0b5-fa3d5b6c1e73 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:43.539628 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c4e9ac21-244b-4f0c-b0b5-fa3d5b6c1e73 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:43.540381 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c4e9ac21-244b-4f0c-b0b5-fa3d5b6c1e73 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:43.540857 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c4e9ac21-244b-4f0c-b0b5-fa3d5b6c1e73 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:43.541278 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c4e9ac21-244b-4f0c-b0b5-fa3d5b6c1e73 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:43.570280 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-c4e9ac21-244b-4f0c-b0b5-fa3d5b6c1e73 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc/ips" status: 200 len: 152 microversion: 2.20 time: 0.046583 Aug 11 11:05:43.570975 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 129/252] 10.222.0.48 () {60 vars in 1289 bytes} [Thu Aug 11 11:05:43 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc/ips => generated 152 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 11:05:47.302199 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-bededd84-f8ee-4184-9137-e95697a9af7c tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Action: 'create', calling method: .version_select at 0x7faab0eac790>, body: {"keypair": {"name": "tempest-keypair-1144576263", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNUD2B1LRIGXveBna/Evf/A9L0DWxfZgytCH8UblYsE4Oh0SRO8VTAyjod4L4Q0gIWDokC7li9Yt4Hj+5gVqZPM3MAeiv8uNEf28KqFe+SKsQuMGLMnVpBYroje8FzoKXg=="}} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:05:47.322334 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.quota [None req-bededd84-f8ee-4184-9137-e95697a9af7c tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Getting quotas for project e8751d4bd74240db9b57b7e9f788df94. Resources: {'key_pairs'} {{(pid=121231) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 11:05:47.343454 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.quota [None req-bededd84-f8ee-4184-9137-e95697a9af7c tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Getting quotas for user 684d59041e82466d8aad6d2964842bf5 and project e8751d4bd74240db9b57b7e9f788df94. Resources: {'key_pairs'} {{(pid=121231) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 11:05:47.465282 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-bededd84-f8ee-4184-9137-e95697a9af7c tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.169096 Aug 11 11:05:47.466587 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 124/253] 10.222.0.48 () {60 vars in 1159 bytes} [Thu Aug 11 11:05:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:05:48.661367 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-772f54a1-107f-4b3a-97e9-3b91f1418a55 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:05:48.661914 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-772f54a1-107f-4b3a-97e9-3b91f1418a55 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:05:48.691861 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-772f54a1-107f-4b3a-97e9-3b91f1418a55 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:48.692367 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-772f54a1-107f-4b3a-97e9-3b91f1418a55 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:48.692811 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-772f54a1-107f-4b3a-97e9-3b91f1418a55 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:48.693536 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-772f54a1-107f-4b3a-97e9-3b91f1418a55 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:48.703513 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-772f54a1-107f-4b3a-97e9-3b91f1418a55 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:48.704380 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-772f54a1-107f-4b3a-97e9-3b91f1418a55 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:48.736474 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.objects.instance [None req-772f54a1-107f-4b3a-97e9-3b91f1418a55 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lazy-loading 'flavor' on Instance uuid 82a61cf6-1f3f-4ced-9806-a06252b9b2cc {{(pid=121232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 11:05:49.628783 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-772f54a1-107f-4b3a-97e9-3b91f1418a55 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "POST /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc/action" status: 202 len: 0 microversion: 2.20 time: 0.971894 Aug 11 11:05:49.632938 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 130/254] 10.222.0.48 () {62 vars in 1319 bytes} [Thu Aug 11 11:05:48 2022] POST /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc/action => generated 0 bytes in 976 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 11 11:05:49.635101 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:05:49.646518 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-e5c3082c-4b90-460e-b951-f4ac42bead5b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:05:49.652839 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-e5c3082c-4b90-460e-b951-f4ac42bead5b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:05:49.668192 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e5c3082c-4b90-460e-b951-f4ac42bead5b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:49.669092 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e5c3082c-4b90-460e-b951-f4ac42bead5b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:49.670802 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e5c3082c-4b90-460e-b951-f4ac42bead5b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:49.671914 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e5c3082c-4b90-460e-b951-f4ac42bead5b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:49.680574 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e5c3082c-4b90-460e-b951-f4ac42bead5b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:49.682999 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e5c3082c-4b90-460e-b951-f4ac42bead5b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:50.081850 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-e5c3082c-4b90-460e-b951-f4ac42bead5b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:05:50.092166 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-e5c3082c-4b90-460e-b951-f4ac42bead5b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:05:50.093676 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-e5c3082c-4b90-460e-b951-f4ac42bead5b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:05:50.094879 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-e5c3082c-4b90-460e-b951-f4ac42bead5b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1721 microversion: 2.20 time: 0.461473 Aug 11 11:05:50.095960 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 125/255] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:05:49 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1721 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:05:50.861513 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-510e659f-ff0c-407e-a536-63a7e9b4b887 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-893702050", "imageRef": "05993162-aafd-4f1d-b781-ec09593713e5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8fa2e066-f14c-4214-a992-60ab79c83482"}], "security_groups": [{"name": "tempest-securitygroup--1831344730"}], "key_name": "tempest-keypair-1144576263", "user_data": "}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:05:51.008758 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.network.neutron [None req-510e659f-ff0c-407e-a536-63a7e9b4b887 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] validate_networks() for [('8fa2e066-f14c-4214-a992-60ab79c83482', None, None, None, None, None)] {{(pid=121232) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 11 11:05:51.121859 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-9d71f4bb-e571-4d02-a64f-3487b96aae23 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:05:51.123158 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-9d71f4bb-e571-4d02-a64f-3487b96aae23 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:05:51.133413 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9d71f4bb-e571-4d02-a64f-3487b96aae23 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:51.134343 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9d71f4bb-e571-4d02-a64f-3487b96aae23 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:51.135268 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9d71f4bb-e571-4d02-a64f-3487b96aae23 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:51.142386 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9d71f4bb-e571-4d02-a64f-3487b96aae23 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:51.144576 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9d71f4bb-e571-4d02-a64f-3487b96aae23 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:51.145234 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9d71f4bb-e571-4d02-a64f-3487b96aae23 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:51.583477 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-9d71f4bb-e571-4d02-a64f-3487b96aae23 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:05:51.608441 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-9d71f4bb-e571-4d02-a64f-3487b96aae23 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:05:51.610658 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-9d71f4bb-e571-4d02-a64f-3487b96aae23 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:05:51.612766 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-9d71f4bb-e571-4d02-a64f-3487b96aae23 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1721 microversion: 2.20 time: 0.496882 Aug 11 11:05:51.627798 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 126/256] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:05:51 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1721 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:05:52.202522 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-510e659f-ff0c-407e-a536-63a7e9b4b887 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Flavor limits 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 11 11:05:52.202522 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-510e659f-ff0c-407e-a536-63a7e9b4b887 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Image limits 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 11 11:05:52.202522 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-510e659f-ff0c-407e-a536-63a7e9b4b887 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Flavor pref 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 11 11:05:52.202522 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-510e659f-ff0c-407e-a536-63a7e9b4b887 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Image pref 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 11 11:05:52.202522 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-510e659f-ff0c-407e-a536-63a7e9b4b887 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 11 11:05:52.206785 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-510e659f-ff0c-407e-a536-63a7e9b4b887 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:52.206785 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-510e659f-ff0c-407e-a536-63a7e9b4b887 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:52.206785 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-510e659f-ff0c-407e-a536-63a7e9b4b887 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:52.206785 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-510e659f-ff0c-407e-a536-63a7e9b4b887 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:52.208524 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-510e659f-ff0c-407e-a536-63a7e9b4b887 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:52.208524 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-510e659f-ff0c-407e-a536-63a7e9b4b887 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:52.208524 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-510e659f-ff0c-407e-a536-63a7e9b4b887 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Getting quotas for project e8751d4bd74240db9b57b7e9f788df94. Resources: {'ram', 'cores', 'instances'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 11:05:52.208524 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-510e659f-ff0c-407e-a536-63a7e9b4b887 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Getting quotas for user 684d59041e82466d8aad6d2964842bf5 and project e8751d4bd74240db9b57b7e9f788df94. Resources: {'ram', 'cores', 'instances'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 11:05:52.209394 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-510e659f-ff0c-407e-a536-63a7e9b4b887 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Going to run 1 instances... {{(pid=121232) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 11 11:05:52.209394 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-510e659f-ff0c-407e-a536-63a7e9b4b887 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 481c1d02-4070-4d58-8be2-438cd1a68eb5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='05993162-aafd-4f1d-b781-ec09593713e5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121232) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 11 11:05:52.542393 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-510e659f-ff0c-407e-a536-63a7e9b4b887 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.685853 Aug 11 11:05:52.543040 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 131/257] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Aug 11 11:05:50 2022] POST /compute/v2.1/servers => generated 409 bytes in 1687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 11 11:05:52.556273 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-4d4931f3-13ad-412d-be04-3bdea4043035 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:05:52.557883 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-4d4931f3-13ad-412d-be04-3bdea4043035 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 481c1d02-4070-4d58-8be2-438cd1a68eb5] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:05:52.564251 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=1 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:05:52.631695 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-4d4931f3-13ad-412d-be04-3bdea4043035 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:05:52.638026 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-4d4931f3-13ad-412d-be04-3bdea4043035 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5" status: 200 len: 1245 microversion: 2.1 time: 0.086679 Aug 11 11:05:52.641337 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 127/258] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:05:52 2022] GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5 => generated 1245 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:05:52.642368 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-caabe344-7ae2-458a-b927-55f5d28530b1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:05:52.644319 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-caabe344-7ae2-458a-b927-55f5d28530b1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:05:52.651119 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-caabe344-7ae2-458a-b927-55f5d28530b1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:52.651706 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-caabe344-7ae2-458a-b927-55f5d28530b1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:52.652222 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-caabe344-7ae2-458a-b927-55f5d28530b1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:52.652985 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-caabe344-7ae2-458a-b927-55f5d28530b1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:52.653506 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-caabe344-7ae2-458a-b927-55f5d28530b1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:52.653930 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-caabe344-7ae2-458a-b927-55f5d28530b1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:52.689556 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:05:53.037379 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-caabe344-7ae2-458a-b927-55f5d28530b1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:05:53.046367 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-caabe344-7ae2-458a-b927-55f5d28530b1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:05:53.048115 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-caabe344-7ae2-458a-b927-55f5d28530b1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:05:53.049548 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-caabe344-7ae2-458a-b927-55f5d28530b1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1721 microversion: 2.20 time: 0.416602 Aug 11 11:05:53.050608 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 132/259] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:05:52 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1721 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 11:05:53.675672 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-1fb78c32-a9cf-4f9e-839b-4e3bfab7136f tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:05:53.677024 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-1fb78c32-a9cf-4f9e-839b-4e3bfab7136f tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 481c1d02-4070-4d58-8be2-438cd1a68eb5] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:05:53.761563 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-1fb78c32-a9cf-4f9e-839b-4e3bfab7136f tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:05:53.775552 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-1fb78c32-a9cf-4f9e-839b-4e3bfab7136f tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5" status: 200 len: 1245 microversion: 2.1 time: 0.107419 Aug 11 11:05:53.788014 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 128/260] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:05:53 2022] GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5 => generated 1245 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:05:54.073800 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-712ffc3f-cb94-4de1-a3a0-e5dd7b037df8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:05:54.074416 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-712ffc3f-cb94-4de1-a3a0-e5dd7b037df8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:05:54.101746 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-712ffc3f-cb94-4de1-a3a0-e5dd7b037df8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:54.102241 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-712ffc3f-cb94-4de1-a3a0-e5dd7b037df8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:54.102678 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-712ffc3f-cb94-4de1-a3a0-e5dd7b037df8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:54.103380 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-712ffc3f-cb94-4de1-a3a0-e5dd7b037df8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:54.103856 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-712ffc3f-cb94-4de1-a3a0-e5dd7b037df8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:54.104291 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-712ffc3f-cb94-4de1-a3a0-e5dd7b037df8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:54.549056 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-712ffc3f-cb94-4de1-a3a0-e5dd7b037df8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:05:54.561537 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-712ffc3f-cb94-4de1-a3a0-e5dd7b037df8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:05:54.564246 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-712ffc3f-cb94-4de1-a3a0-e5dd7b037df8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:05:54.566169 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-712ffc3f-cb94-4de1-a3a0-e5dd7b037df8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1721 microversion: 2.20 time: 0.496332 Aug 11 11:05:54.582179 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 133/261] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:05:54 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1721 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:05:54.803818 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-1fb30711-2ea2-4bda-9358-08c28ca306ad tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:05:54.804313 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-1fb30711-2ea2-4bda-9358-08c28ca306ad tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 481c1d02-4070-4d58-8be2-438cd1a68eb5] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:05:54.813292 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-a9986ab8-bbfa-4e13-84ae-f58442d6d0db tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:05:54.821833 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1fb30711-2ea2-4bda-9358-08c28ca306ad tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:54.823252 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1fb30711-2ea2-4bda-9358-08c28ca306ad tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:54.825383 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1fb30711-2ea2-4bda-9358-08c28ca306ad tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:54.829694 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1fb30711-2ea2-4bda-9358-08c28ca306ad tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:54.829694 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1fb30711-2ea2-4bda-9358-08c28ca306ad tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:54.829694 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1fb30711-2ea2-4bda-9358-08c28ca306ad tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:54.835920 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a9986ab8-bbfa-4e13-84ae-f58442d6d0db tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:54.836487 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a9986ab8-bbfa-4e13-84ae-f58442d6d0db tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:54.836981 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a9986ab8-bbfa-4e13-84ae-f58442d6d0db tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:54.929084 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-a9986ab8-bbfa-4e13-84ae-f58442d6d0db tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Going to try to stop instance {{(pid=121232) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 11 11:05:54.985199 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-1fb30711-2ea2-4bda-9358-08c28ca306ad tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:05:54.998445 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-1fb30711-2ea2-4bda-9358-08c28ca306ad tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5" status: 200 len: 1241 microversion: 2.1 time: 0.202856 Aug 11 11:05:54.999680 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 129/262] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:05:54 2022] GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5 => generated 1241 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:05:55.253261 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-a9986ab8-bbfa-4e13-84ae-f58442d6d0db tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "POST /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935/action" status: 202 len: 0 microversion: 2.1 time: 0.444802 Aug 11 11:05:55.254350 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 134/263] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Aug 11 11:05:54 2022] POST /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935/action => generated 0 bytes in 447 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 11 11:05:55.264402 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-4a26a350-7342-4502-85dd-a487f41b5847 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:05:55.265009 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-4a26a350-7342-4502-85dd-a487f41b5847 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:05:55.286130 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4a26a350-7342-4502-85dd-a487f41b5847 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:55.286892 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4a26a350-7342-4502-85dd-a487f41b5847 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:55.287480 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4a26a350-7342-4502-85dd-a487f41b5847 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:55.288256 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4a26a350-7342-4502-85dd-a487f41b5847 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:55.289006 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4a26a350-7342-4502-85dd-a487f41b5847 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:55.289447 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4a26a350-7342-4502-85dd-a487f41b5847 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:55.547037 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-4a26a350-7342-4502-85dd-a487f41b5847 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:05:55.556851 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-4a26a350-7342-4502-85dd-a487f41b5847 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1724 microversion: 2.1 time: 0.296711 Aug 11 11:05:55.559223 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 130/264] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:05:55 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1724 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:05:55.595236 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-9861c766-6ea0-470b-95c1-720f39530aee tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:05:55.596026 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-9861c766-6ea0-470b-95c1-720f39530aee tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:05:55.605396 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9861c766-6ea0-470b-95c1-720f39530aee tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:55.606124 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9861c766-6ea0-470b-95c1-720f39530aee tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:55.607501 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9861c766-6ea0-470b-95c1-720f39530aee tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:55.608471 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9861c766-6ea0-470b-95c1-720f39530aee tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:55.609391 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9861c766-6ea0-470b-95c1-720f39530aee tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:55.610009 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9861c766-6ea0-470b-95c1-720f39530aee tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:56.018963 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-30fcc87b-0a29-4dc7-bb32-dfbd9f426e5e tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:05:56.019581 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-30fcc87b-0a29-4dc7-bb32-dfbd9f426e5e tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 481c1d02-4070-4d58-8be2-438cd1a68eb5] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:05:56.029619 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-30fcc87b-0a29-4dc7-bb32-dfbd9f426e5e tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:56.030111 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-30fcc87b-0a29-4dc7-bb32-dfbd9f426e5e tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:56.030543 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-30fcc87b-0a29-4dc7-bb32-dfbd9f426e5e tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:56.032481 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-30fcc87b-0a29-4dc7-bb32-dfbd9f426e5e tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:56.033134 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-30fcc87b-0a29-4dc7-bb32-dfbd9f426e5e tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:56.034498 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-30fcc87b-0a29-4dc7-bb32-dfbd9f426e5e tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:56.153264 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-30fcc87b-0a29-4dc7-bb32-dfbd9f426e5e tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:05:56.161397 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-30fcc87b-0a29-4dc7-bb32-dfbd9f426e5e tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5" status: 200 len: 1297 microversion: 2.1 time: 0.146458 Aug 11 11:05:56.161973 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 131/265] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:05:56 2022] GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5 => generated 1297 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:05:56.197691 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-9861c766-6ea0-470b-95c1-720f39530aee tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:05:56.206220 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-9861c766-6ea0-470b-95c1-720f39530aee tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:05:56.208459 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-9861c766-6ea0-470b-95c1-720f39530aee tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:05:56.209112 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-9861c766-6ea0-470b-95c1-720f39530aee tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1721 microversion: 2.20 time: 0.620771 Aug 11 11:05:56.209927 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 135/266] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:05:55 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1721 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:05:56.579072 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-b16cc1ba-fe67-4d7d-a43a-e590273f05e5 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:05:56.579972 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-b16cc1ba-fe67-4d7d-a43a-e590273f05e5 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:05:56.614941 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b16cc1ba-fe67-4d7d-a43a-e590273f05e5 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:56.615724 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b16cc1ba-fe67-4d7d-a43a-e590273f05e5 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:56.616113 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b16cc1ba-fe67-4d7d-a43a-e590273f05e5 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:56.616825 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b16cc1ba-fe67-4d7d-a43a-e590273f05e5 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:56.620328 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b16cc1ba-fe67-4d7d-a43a-e590273f05e5 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:56.620781 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b16cc1ba-fe67-4d7d-a43a-e590273f05e5 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:57.013541 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-b16cc1ba-fe67-4d7d-a43a-e590273f05e5 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:05:57.021906 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-b16cc1ba-fe67-4d7d-a43a-e590273f05e5 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1724 microversion: 2.1 time: 0.447268 Aug 11 11:05:57.024061 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 132/267] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:05:56 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1724 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:05:57.185521 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-a3bc4130-d83b-4554-b997-dceec21c5261 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:05:57.186242 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-a3bc4130-d83b-4554-b997-dceec21c5261 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 481c1d02-4070-4d58-8be2-438cd1a68eb5] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:05:57.192900 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a3bc4130-d83b-4554-b997-dceec21c5261 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:57.193389 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a3bc4130-d83b-4554-b997-dceec21c5261 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:57.193825 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a3bc4130-d83b-4554-b997-dceec21c5261 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:57.194892 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a3bc4130-d83b-4554-b997-dceec21c5261 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:57.195457 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a3bc4130-d83b-4554-b997-dceec21c5261 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:57.196088 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a3bc4130-d83b-4554-b997-dceec21c5261 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:57.237448 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-301c98fb-dc9d-425f-ad22-707389e29aba tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:05:57.238408 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-301c98fb-dc9d-425f-ad22-707389e29aba tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:05:57.274615 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-301c98fb-dc9d-425f-ad22-707389e29aba tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:57.275077 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-301c98fb-dc9d-425f-ad22-707389e29aba tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:57.281067 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-301c98fb-dc9d-425f-ad22-707389e29aba tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:57.285021 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-301c98fb-dc9d-425f-ad22-707389e29aba tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:57.285757 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-301c98fb-dc9d-425f-ad22-707389e29aba tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:57.288339 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-301c98fb-dc9d-425f-ad22-707389e29aba tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:57.594547 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-a3bc4130-d83b-4554-b997-dceec21c5261 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:05:57.616440 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-a3bc4130-d83b-4554-b997-dceec21c5261 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5" status: 200 len: 1303 microversion: 2.1 time: 0.435192 Aug 11 11:05:57.630849 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 136/268] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:05:57 2022] GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5 => generated 1303 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:05:57.740986 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-301c98fb-dc9d-425f-ad22-707389e29aba tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:05:57.756547 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-301c98fb-dc9d-425f-ad22-707389e29aba tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:05:57.758199 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-301c98fb-dc9d-425f-ad22-707389e29aba tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:05:57.759331 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-301c98fb-dc9d-425f-ad22-707389e29aba tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1721 microversion: 2.20 time: 0.529422 Aug 11 11:05:57.760232 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 133/269] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:05:57 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1721 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 11:05:58.045771 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-50976a07-2a57-4b47-9ce1-2ad82c24ddde tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:05:58.046407 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-50976a07-2a57-4b47-9ce1-2ad82c24ddde tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:05:58.053247 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-50976a07-2a57-4b47-9ce1-2ad82c24ddde tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:58.053739 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-50976a07-2a57-4b47-9ce1-2ad82c24ddde tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:58.054244 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-50976a07-2a57-4b47-9ce1-2ad82c24ddde tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:58.055205 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-50976a07-2a57-4b47-9ce1-2ad82c24ddde tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:58.055593 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-50976a07-2a57-4b47-9ce1-2ad82c24ddde tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:58.056176 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-50976a07-2a57-4b47-9ce1-2ad82c24ddde tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:58.532184 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-50976a07-2a57-4b47-9ce1-2ad82c24ddde tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:05:58.546556 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-50976a07-2a57-4b47-9ce1-2ad82c24ddde tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1724 microversion: 2.1 time: 0.504544 Aug 11 11:05:58.551049 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 137/270] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:05:58 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1724 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:05:58.638134 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-cf761678-da0e-4b21-bdf4-8cdf645e8350 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:05:58.638908 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-cf761678-da0e-4b21-bdf4-8cdf645e8350 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 481c1d02-4070-4d58-8be2-438cd1a68eb5] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:05:58.646558 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-cf761678-da0e-4b21-bdf4-8cdf645e8350 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:58.650473 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-cf761678-da0e-4b21-bdf4-8cdf645e8350 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:58.650473 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-cf761678-da0e-4b21-bdf4-8cdf645e8350 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:58.652710 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-cf761678-da0e-4b21-bdf4-8cdf645e8350 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:58.653196 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-cf761678-da0e-4b21-bdf4-8cdf645e8350 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:58.656345 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-cf761678-da0e-4b21-bdf4-8cdf645e8350 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:58.782567 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-405393a7-cb32-4421-9e45-3e24ba99cf07 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:05:58.783694 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-405393a7-cb32-4421-9e45-3e24ba99cf07 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:05:58.792338 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-405393a7-cb32-4421-9e45-3e24ba99cf07 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:58.794230 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-405393a7-cb32-4421-9e45-3e24ba99cf07 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:58.795013 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-405393a7-cb32-4421-9e45-3e24ba99cf07 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:58.799562 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-405393a7-cb32-4421-9e45-3e24ba99cf07 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:58.800240 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-405393a7-cb32-4421-9e45-3e24ba99cf07 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:58.802282 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-405393a7-cb32-4421-9e45-3e24ba99cf07 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:58.997055 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-cf761678-da0e-4b21-bdf4-8cdf645e8350 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:05:59.024014 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-cf761678-da0e-4b21-bdf4-8cdf645e8350 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5" status: 200 len: 1371 microversion: 2.1 time: 0.386602 Aug 11 11:05:59.037736 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 134/271] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:05:58 2022] GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5 => generated 1371 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:05:59.202981 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-405393a7-cb32-4421-9e45-3e24ba99cf07 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:05:59.218465 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-405393a7-cb32-4421-9e45-3e24ba99cf07 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:05:59.222614 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-405393a7-cb32-4421-9e45-3e24ba99cf07 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:05:59.230250 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-405393a7-cb32-4421-9e45-3e24ba99cf07 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1721 microversion: 2.20 time: 0.451587 Aug 11 11:05:59.233823 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 138/272] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:05:58 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1721 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 11:05:59.577099 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-88722778-9738-402b-9bf8-f0c7f3d3b277 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:05:59.593505 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-88722778-9738-402b-9bf8-f0c7f3d3b277 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:05:59.603884 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-88722778-9738-402b-9bf8-f0c7f3d3b277 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:59.604605 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-88722778-9738-402b-9bf8-f0c7f3d3b277 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:59.605210 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-88722778-9738-402b-9bf8-f0c7f3d3b277 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:59.606132 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-88722778-9738-402b-9bf8-f0c7f3d3b277 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:59.606742 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-88722778-9738-402b-9bf8-f0c7f3d3b277 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:59.607318 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-88722778-9738-402b-9bf8-f0c7f3d3b277 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:59.837011 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-0486e9cb-21fe-40dc-8ff8-77fb646924b7 req-aad4448c-3bb4-4104-bd3f-d7b3328f0a84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "481c1d02-4070-4d58-8be2-438cd1a68eb5", "tag": "9c6e465a-0bd3-4725-9e9b-81120495670d"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:05:59.854935 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-0486e9cb-21fe-40dc-8ff8-77fb646924b7 req-aad4448c-3bb4-4104-bd3f-d7b3328f0a84 service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:05:59.864508 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-0486e9cb-21fe-40dc-8ff8-77fb646924b7 req-aad4448c-3bb4-4104-bd3f-d7b3328f0a84 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:05:59.865752 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-0486e9cb-21fe-40dc-8ff8-77fb646924b7 req-aad4448c-3bb4-4104-bd3f-d7b3328f0a84 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:05:59.881392 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-0486e9cb-21fe-40dc-8ff8-77fb646924b7 req-aad4448c-3bb4-4104-bd3f-d7b3328f0a84 service nova] Creating event network-changed:9c6e465a-0bd3-4725-9e9b-81120495670d for instance 481c1d02-4070-4d58-8be2-438cd1a68eb5 on hv-cinder-82002 Aug 11 11:05:59.897047 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-0486e9cb-21fe-40dc-8ff8-77fb646924b7 req-aad4448c-3bb4-4104-bd3f-d7b3328f0a84 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064029 Aug 11 11:05:59.898177 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 139/273] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:05:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 11:05:59.968964 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-88722778-9738-402b-9bf8-f0c7f3d3b277 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:00.002538 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-88722778-9738-402b-9bf8-f0c7f3d3b277 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1724 microversion: 2.1 time: 0.408583 Aug 11 11:06:00.002538 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 135/274] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:05:59 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1724 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:00.074054 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-3b18fd5a-3e5e-47ea-9a5b-1e9413b1cf75 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:00.074054 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-3b18fd5a-3e5e-47ea-9a5b-1e9413b1cf75 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 481c1d02-4070-4d58-8be2-438cd1a68eb5] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:00.092253 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3b18fd5a-3e5e-47ea-9a5b-1e9413b1cf75 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:00.095595 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3b18fd5a-3e5e-47ea-9a5b-1e9413b1cf75 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:00.096394 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3b18fd5a-3e5e-47ea-9a5b-1e9413b1cf75 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:00.098642 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3b18fd5a-3e5e-47ea-9a5b-1e9413b1cf75 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:00.098642 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3b18fd5a-3e5e-47ea-9a5b-1e9413b1cf75 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:00.100877 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3b18fd5a-3e5e-47ea-9a5b-1e9413b1cf75 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:00.260827 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-71e1afcf-2e84-4182-84b7-2555c98042ac tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:00.261451 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-71e1afcf-2e84-4182-84b7-2555c98042ac tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:00.279966 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-71e1afcf-2e84-4182-84b7-2555c98042ac tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:00.284205 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-71e1afcf-2e84-4182-84b7-2555c98042ac tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:00.284545 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-71e1afcf-2e84-4182-84b7-2555c98042ac tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:00.287015 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-71e1afcf-2e84-4182-84b7-2555c98042ac tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:00.289056 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-71e1afcf-2e84-4182-84b7-2555c98042ac tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:00.294836 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-71e1afcf-2e84-4182-84b7-2555c98042ac tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:00.589947 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-71e1afcf-2e84-4182-84b7-2555c98042ac tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:00.604542 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-71e1afcf-2e84-4182-84b7-2555c98042ac tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:00.606747 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-71e1afcf-2e84-4182-84b7-2555c98042ac tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:00.627332 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-71e1afcf-2e84-4182-84b7-2555c98042ac tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1721 microversion: 2.20 time: 0.370850 Aug 11 11:06:00.634054 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 136/275] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:06:00 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1721 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 11:06:00.755513 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-3b18fd5a-3e5e-47ea-9a5b-1e9413b1cf75 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:00.763912 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-3b18fd5a-3e5e-47ea-9a5b-1e9413b1cf75 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5" status: 200 len: 1371 microversion: 2.1 time: 0.721391 Aug 11 11:06:00.765167 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 140/276] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:00 2022] GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5 => generated 1371 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:01.006714 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-b218dceb-b64d-4e68-891d-32a260534800 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:01.007959 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-b218dceb-b64d-4e68-891d-32a260534800 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:01.016671 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b218dceb-b64d-4e68-891d-32a260534800 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:01.018356 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b218dceb-b64d-4e68-891d-32a260534800 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:01.019006 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b218dceb-b64d-4e68-891d-32a260534800 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:01.020127 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b218dceb-b64d-4e68-891d-32a260534800 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:01.020953 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b218dceb-b64d-4e68-891d-32a260534800 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:01.021568 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b218dceb-b64d-4e68-891d-32a260534800 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:01.356710 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-2446caad-930e-4f2b-8203-bf1cea7da635 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ab1d6ce4-6b0c-42e9-a080-8ea66f414772", "device": "/dev/sdb"}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:06:01.358486 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-2446caad-930e-4f2b-8203-bf1cea7da635 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] [instance: b2d65671-2e58-41ac-9aa1-245420900315] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:01.363076 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-b218dceb-b64d-4e68-891d-32a260534800 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:01.373748 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-b218dceb-b64d-4e68-891d-32a260534800 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1724 microversion: 2.1 time: 0.373362 Aug 11 11:06:01.378582 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2446caad-930e-4f2b-8203-bf1cea7da635 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:01.380721 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2446caad-930e-4f2b-8203-bf1cea7da635 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:01.386920 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2446caad-930e-4f2b-8203-bf1cea7da635 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:01.386920 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2446caad-930e-4f2b-8203-bf1cea7da635 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:01.386920 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2446caad-930e-4f2b-8203-bf1cea7da635 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:01.386920 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2446caad-930e-4f2b-8203-bf1cea7da635 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:01.389268 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 137/277] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:00 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1724 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:01.670169 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-90c08da9-c837-4310-ba84-e159a2fbab19 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:01.670169 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-90c08da9-c837-4310-ba84-e159a2fbab19 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:01.670169 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-90c08da9-c837-4310-ba84-e159a2fbab19 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:01.670169 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-90c08da9-c837-4310-ba84-e159a2fbab19 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:01.670500 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-90c08da9-c837-4310-ba84-e159a2fbab19 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:01.671106 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-90c08da9-c837-4310-ba84-e159a2fbab19 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:01.671703 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-90c08da9-c837-4310-ba84-e159a2fbab19 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:01.672521 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-90c08da9-c837-4310-ba84-e159a2fbab19 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:01.875979 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-90c08da9-c837-4310-ba84-e159a2fbab19 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:01.890982 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-90c08da9-c837-4310-ba84-e159a2fbab19 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:01.897028 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-90c08da9-c837-4310-ba84-e159a2fbab19 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:01.898961 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-90c08da9-c837-4310-ba84-e159a2fbab19 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1721 microversion: 2.20 time: 0.248397 Aug 11 11:06:01.905620 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 138/278] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:06:01 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1721 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 11:06:01.910494 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-445ce80e-7c1a-4d33-be43-57a0e2223561 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:01.911348 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-445ce80e-7c1a-4d33-be43-57a0e2223561 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 481c1d02-4070-4d58-8be2-438cd1a68eb5] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:01.921949 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-445ce80e-7c1a-4d33-be43-57a0e2223561 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:01.922710 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-445ce80e-7c1a-4d33-be43-57a0e2223561 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:01.925945 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-445ce80e-7c1a-4d33-be43-57a0e2223561 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:01.926942 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-445ce80e-7c1a-4d33-be43-57a0e2223561 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:01.927629 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-445ce80e-7c1a-4d33-be43-57a0e2223561 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:01.928328 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-445ce80e-7c1a-4d33-be43-57a0e2223561 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:02.119569 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-445ce80e-7c1a-4d33-be43-57a0e2223561 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:02.128430 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-445ce80e-7c1a-4d33-be43-57a0e2223561 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5" status: 200 len: 1371 microversion: 2.1 time: 0.224650 Aug 11 11:06:02.130826 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 139/279] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:01 2022] GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5 => generated 1371 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:02.144000 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell0:SELECT=2 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:02.190034 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell0:SELECT=6 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:02.399017 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-edf04377-d5ee-48ba-aedd-bb0cdca3d397 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:02.399980 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-edf04377-d5ee-48ba-aedd-bb0cdca3d397 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:02.406380 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-edf04377-d5ee-48ba-aedd-bb0cdca3d397 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:02.407041 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-edf04377-d5ee-48ba-aedd-bb0cdca3d397 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:02.407637 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-edf04377-d5ee-48ba-aedd-bb0cdca3d397 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:02.409063 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-edf04377-d5ee-48ba-aedd-bb0cdca3d397 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:02.409667 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-edf04377-d5ee-48ba-aedd-bb0cdca3d397 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:02.415269 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-edf04377-d5ee-48ba-aedd-bb0cdca3d397 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:02.686808 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-edf04377-d5ee-48ba-aedd-bb0cdca3d397 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:02.743893 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-edf04377-d5ee-48ba-aedd-bb0cdca3d397 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1724 microversion: 2.1 time: 0.348494 Aug 11 11:06:02.744452 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 140/280] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:02 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1724 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:06:02.936853 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-4d1d450d-f757-4ac1-b797-9e0788efab0a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:02.938768 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-4d1d450d-f757-4ac1-b797-9e0788efab0a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:02.947715 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4d1d450d-f757-4ac1-b797-9e0788efab0a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:02.949076 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4d1d450d-f757-4ac1-b797-9e0788efab0a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:02.949751 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4d1d450d-f757-4ac1-b797-9e0788efab0a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:02.951072 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4d1d450d-f757-4ac1-b797-9e0788efab0a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:02.952064 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4d1d450d-f757-4ac1-b797-9e0788efab0a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:02.952874 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4d1d450d-f757-4ac1-b797-9e0788efab0a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:03.173756 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-4d1d450d-f757-4ac1-b797-9e0788efab0a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:03.182789 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-4d1d450d-f757-4ac1-b797-9e0788efab0a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:03.184522 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-4d1d450d-f757-4ac1-b797-9e0788efab0a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:03.185763 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-4d1d450d-f757-4ac1-b797-9e0788efab0a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1721 microversion: 2.20 time: 0.253946 Aug 11 11:06:03.186394 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 141/281] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:06:02 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1721 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 11:06:03.191746 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-8d169a1a-6d0a-4fb6-a285-17c2c08fbae7 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:03.192536 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-8d169a1a-6d0a-4fb6-a285-17c2c08fbae7 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 481c1d02-4070-4d58-8be2-438cd1a68eb5] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:03.198725 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8d169a1a-6d0a-4fb6-a285-17c2c08fbae7 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:03.199366 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8d169a1a-6d0a-4fb6-a285-17c2c08fbae7 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:03.199860 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8d169a1a-6d0a-4fb6-a285-17c2c08fbae7 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:03.200902 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8d169a1a-6d0a-4fb6-a285-17c2c08fbae7 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:03.201359 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8d169a1a-6d0a-4fb6-a285-17c2c08fbae7 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:03.201780 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8d169a1a-6d0a-4fb6-a285-17c2c08fbae7 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:03.373433 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-8d169a1a-6d0a-4fb6-a285-17c2c08fbae7 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:03.381405 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-8d169a1a-6d0a-4fb6-a285-17c2c08fbae7 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5" status: 200 len: 1371 microversion: 2.1 time: 0.193922 Aug 11 11:06:03.381957 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 142/282] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:03 2022] GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5 => generated 1371 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:03.767322 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-8c63d175-5e88-43fd-9a95-668d9479753d tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:03.768200 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-8c63d175-5e88-43fd-9a95-668d9479753d tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:03.778011 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell0:SELECT=8 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:03.780086 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8c63d175-5e88-43fd-9a95-668d9479753d tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:03.780829 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8c63d175-5e88-43fd-9a95-668d9479753d tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:03.781572 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8c63d175-5e88-43fd-9a95-668d9479753d tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:03.783746 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8c63d175-5e88-43fd-9a95-668d9479753d tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:03.784920 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8c63d175-5e88-43fd-9a95-668d9479753d tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:03.785663 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8c63d175-5e88-43fd-9a95-668d9479753d tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:03.811081 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-2446caad-930e-4f2b-8203-bf1cea7da635 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] 10.222.0.48 "POST /compute/v2.1/servers/b2d65671-2e58-41ac-9aa1-245420900315/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.463477 Aug 11 11:06:03.819648 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 141/283] 10.222.0.48 () {60 vars in 1323 bytes} [Thu Aug 11 11:06:01 2022] POST /compute/v2.1/servers/b2d65671-2e58-41ac-9aa1-245420900315/os-volume_attachments => generated 194 bytes in 2473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:06:03.836856 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell1:SELECT=100 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:04.064682 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-8c63d175-5e88-43fd-9a95-668d9479753d tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:04.075304 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-8c63d175-5e88-43fd-9a95-668d9479753d tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1724 microversion: 2.1 time: 0.311922 Aug 11 11:06:04.076677 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 143/284] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:03 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1724 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:04.211073 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-02dc12a0-5689-4e8e-b049-4f2a783bc2ec tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:04.212503 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-02dc12a0-5689-4e8e-b049-4f2a783bc2ec tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:04.220453 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-02dc12a0-5689-4e8e-b049-4f2a783bc2ec tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:04.221288 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-02dc12a0-5689-4e8e-b049-4f2a783bc2ec tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:04.221971 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-02dc12a0-5689-4e8e-b049-4f2a783bc2ec tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:04.223194 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-02dc12a0-5689-4e8e-b049-4f2a783bc2ec tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:04.223959 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-02dc12a0-5689-4e8e-b049-4f2a783bc2ec tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:04.224639 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-02dc12a0-5689-4e8e-b049-4f2a783bc2ec tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:04.402378 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-6765506b-9da7-4e5f-96d1-35350ada4ffd tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:04.403073 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-6765506b-9da7-4e5f-96d1-35350ada4ffd tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 481c1d02-4070-4d58-8be2-438cd1a68eb5] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:04.411654 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6765506b-9da7-4e5f-96d1-35350ada4ffd tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:04.418013 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6765506b-9da7-4e5f-96d1-35350ada4ffd tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:04.422047 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6765506b-9da7-4e5f-96d1-35350ada4ffd tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:04.423731 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6765506b-9da7-4e5f-96d1-35350ada4ffd tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:04.424240 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6765506b-9da7-4e5f-96d1-35350ada4ffd tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:04.424663 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6765506b-9da7-4e5f-96d1-35350ada4ffd tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:04.497256 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-02dc12a0-5689-4e8e-b049-4f2a783bc2ec tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:04.512178 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-02dc12a0-5689-4e8e-b049-4f2a783bc2ec tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:04.515578 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-02dc12a0-5689-4e8e-b049-4f2a783bc2ec tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:04.518595 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-02dc12a0-5689-4e8e-b049-4f2a783bc2ec tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1721 microversion: 2.20 time: 0.312987 Aug 11 11:06:04.519862 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 142/285] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:06:04 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1721 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:06:04.623782 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-6765506b-9da7-4e5f-96d1-35350ada4ffd tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:04.637030 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-6765506b-9da7-4e5f-96d1-35350ada4ffd tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5" status: 200 len: 1371 microversion: 2.1 time: 0.235528 Aug 11 11:06:04.640023 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 144/286] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:04 2022] GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5 => generated 1371 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:05.101291 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-ec94d4b1-87c3-4660-ac4b-efe9fdc01622 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:05.103256 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-ec94d4b1-87c3-4660-ac4b-efe9fdc01622 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:05.113860 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ec94d4b1-87c3-4660-ac4b-efe9fdc01622 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:05.116877 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ec94d4b1-87c3-4660-ac4b-efe9fdc01622 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:05.116877 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ec94d4b1-87c3-4660-ac4b-efe9fdc01622 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:05.117555 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ec94d4b1-87c3-4660-ac4b-efe9fdc01622 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:05.118311 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ec94d4b1-87c3-4660-ac4b-efe9fdc01622 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:05.118972 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ec94d4b1-87c3-4660-ac4b-efe9fdc01622 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:05.277200 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-ec94d4b1-87c3-4660-ac4b-efe9fdc01622 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:05.286980 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-ec94d4b1-87c3-4660-ac4b-efe9fdc01622 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1724 microversion: 2.1 time: 0.192366 Aug 11 11:06:05.288224 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 143/287] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:05 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1724 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:05.543184 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-63fce82d-8f74-4846-b8d1-a725e3ba26cc tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:05.543705 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-63fce82d-8f74-4846-b8d1-a725e3ba26cc tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:05.554193 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-63fce82d-8f74-4846-b8d1-a725e3ba26cc tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:05.554974 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-63fce82d-8f74-4846-b8d1-a725e3ba26cc tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:05.555573 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-63fce82d-8f74-4846-b8d1-a725e3ba26cc tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:05.556488 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-63fce82d-8f74-4846-b8d1-a725e3ba26cc tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:05.557091 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-63fce82d-8f74-4846-b8d1-a725e3ba26cc tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:05.557662 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-63fce82d-8f74-4846-b8d1-a725e3ba26cc tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:05.664530 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-7edbb3bb-f067-4bdb-9039-e375b05ef0b4 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:05.665725 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-7edbb3bb-f067-4bdb-9039-e375b05ef0b4 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 481c1d02-4070-4d58-8be2-438cd1a68eb5] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:05.672713 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7edbb3bb-f067-4bdb-9039-e375b05ef0b4 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:05.673556 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7edbb3bb-f067-4bdb-9039-e375b05ef0b4 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:05.674129 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7edbb3bb-f067-4bdb-9039-e375b05ef0b4 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:05.674986 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7edbb3bb-f067-4bdb-9039-e375b05ef0b4 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:05.675612 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7edbb3bb-f067-4bdb-9039-e375b05ef0b4 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:05.678250 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7edbb3bb-f067-4bdb-9039-e375b05ef0b4 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:05.782806 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-63fce82d-8f74-4846-b8d1-a725e3ba26cc tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:05.793324 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-63fce82d-8f74-4846-b8d1-a725e3ba26cc tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:05.795085 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-63fce82d-8f74-4846-b8d1-a725e3ba26cc tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:05.796638 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-63fce82d-8f74-4846-b8d1-a725e3ba26cc tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1721 microversion: 2.20 time: 0.257994 Aug 11 11:06:05.808573 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 145/288] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:06:05 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1721 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:06:05.861572 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-7edbb3bb-f067-4bdb-9039-e375b05ef0b4 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:05.870186 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-7edbb3bb-f067-4bdb-9039-e375b05ef0b4 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5" status: 200 len: 1371 microversion: 2.1 time: 0.213866 Aug 11 11:06:05.870765 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 144/289] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:05 2022] GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5 => generated 1371 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:06:06.315336 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-a951a92d-41a0-4a77-8754-6b0dc7b71f06 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:06.316605 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-a951a92d-41a0-4a77-8754-6b0dc7b71f06 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:06.323578 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a951a92d-41a0-4a77-8754-6b0dc7b71f06 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:06.324148 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a951a92d-41a0-4a77-8754-6b0dc7b71f06 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:06.324963 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a951a92d-41a0-4a77-8754-6b0dc7b71f06 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:06.325670 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a951a92d-41a0-4a77-8754-6b0dc7b71f06 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:06.326292 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a951a92d-41a0-4a77-8754-6b0dc7b71f06 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:06.326719 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a951a92d-41a0-4a77-8754-6b0dc7b71f06 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:06.541325 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-a951a92d-41a0-4a77-8754-6b0dc7b71f06 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:06.568403 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-a951a92d-41a0-4a77-8754-6b0dc7b71f06 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1724 microversion: 2.1 time: 0.258511 Aug 11 11:06:06.580914 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 146/290] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:06 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1724 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:06.615670 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-791c91db-dd19-4717-825c-edba69019534 req-8f3292e4-1cab-4c8d-880a-476181e471c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "481c1d02-4070-4d58-8be2-438cd1a68eb5", "name": "network-vif-plugged", "status": "completed", "tag": "9c6e465a-0bd3-4725-9e9b-81120495670d"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:06:06.627596 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-791c91db-dd19-4717-825c-edba69019534 req-8f3292e4-1cab-4c8d-880a-476181e471c9 service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:06.628192 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-791c91db-dd19-4717-825c-edba69019534 req-8f3292e4-1cab-4c8d-880a-476181e471c9 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:06.628688 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-791c91db-dd19-4717-825c-edba69019534 req-8f3292e4-1cab-4c8d-880a-476181e471c9 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:06.641570 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-791c91db-dd19-4717-825c-edba69019534 req-8f3292e4-1cab-4c8d-880a-476181e471c9 service nova] Creating event network-vif-plugged:9c6e465a-0bd3-4725-9e9b-81120495670d for instance 481c1d02-4070-4d58-8be2-438cd1a68eb5 on hv-cinder-82002 Aug 11 11:06:06.646494 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-791c91db-dd19-4717-825c-edba69019534 req-8f3292e4-1cab-4c8d-880a-476181e471c9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035339 Aug 11 11:06:06.647105 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 145/291] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:06:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:06:06.822952 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-bd9ac8bb-a121-4be8-9c7b-4696263eba90 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:06.823481 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-bd9ac8bb-a121-4be8-9c7b-4696263eba90 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:06.829771 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-bd9ac8bb-a121-4be8-9c7b-4696263eba90 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:06.830248 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-bd9ac8bb-a121-4be8-9c7b-4696263eba90 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:06.830675 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-bd9ac8bb-a121-4be8-9c7b-4696263eba90 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:06.831352 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-bd9ac8bb-a121-4be8-9c7b-4696263eba90 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:06.831814 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-bd9ac8bb-a121-4be8-9c7b-4696263eba90 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:06.832230 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-bd9ac8bb-a121-4be8-9c7b-4696263eba90 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:06.896384 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-c8eadbb1-f288-469a-887b-a1ea6917c965 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:06.897220 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-c8eadbb1-f288-469a-887b-a1ea6917c965 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 481c1d02-4070-4d58-8be2-438cd1a68eb5] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:06.903525 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c8eadbb1-f288-469a-887b-a1ea6917c965 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:06.904043 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c8eadbb1-f288-469a-887b-a1ea6917c965 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:06.904676 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c8eadbb1-f288-469a-887b-a1ea6917c965 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:06.905378 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c8eadbb1-f288-469a-887b-a1ea6917c965 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:06.905835 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c8eadbb1-f288-469a-887b-a1ea6917c965 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:06.906261 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c8eadbb1-f288-469a-887b-a1ea6917c965 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:06.994331 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-bd9ac8bb-a121-4be8-9c7b-4696263eba90 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:07.002308 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-bd9ac8bb-a121-4be8-9c7b-4696263eba90 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:07.024686 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-bd9ac8bb-a121-4be8-9c7b-4696263eba90 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:07.026141 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-bd9ac8bb-a121-4be8-9c7b-4696263eba90 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1742 microversion: 2.20 time: 0.207050 Aug 11 11:06:07.026740 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 147/292] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:06:06 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1742 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:06:07.060814 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-c8eadbb1-f288-469a-887b-a1ea6917c965 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:07.068939 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-c8eadbb1-f288-469a-887b-a1ea6917c965 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5" status: 200 len: 1371 microversion: 2.1 time: 0.178100 Aug 11 11:06:07.069502 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 146/293] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:06 2022] GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5 => generated 1371 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:07.607438 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-729c6509-d9f2-4716-b91f-fe9f417b31f8 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:07.608088 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-729c6509-d9f2-4716-b91f-fe9f417b31f8 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:07.626699 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-729c6509-d9f2-4716-b91f-fe9f417b31f8 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:07.626699 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-729c6509-d9f2-4716-b91f-fe9f417b31f8 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:07.626699 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-729c6509-d9f2-4716-b91f-fe9f417b31f8 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:07.626699 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-729c6509-d9f2-4716-b91f-fe9f417b31f8 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:07.626994 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-729c6509-d9f2-4716-b91f-fe9f417b31f8 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:07.626994 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-729c6509-d9f2-4716-b91f-fe9f417b31f8 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:07.804652 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-729c6509-d9f2-4716-b91f-fe9f417b31f8 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:07.814347 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-729c6509-d9f2-4716-b91f-fe9f417b31f8 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1724 microversion: 2.1 time: 0.219256 Aug 11 11:06:07.814924 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 148/294] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:07 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1724 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:08.049299 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-ae2f5e69-ed32-4a14-a42f-96b693df07e9 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:08.050715 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-ae2f5e69-ed32-4a14-a42f-96b693df07e9 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:08.057294 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ae2f5e69-ed32-4a14-a42f-96b693df07e9 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:08.057998 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ae2f5e69-ed32-4a14-a42f-96b693df07e9 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:08.058597 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ae2f5e69-ed32-4a14-a42f-96b693df07e9 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:08.059440 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ae2f5e69-ed32-4a14-a42f-96b693df07e9 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:08.060201 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ae2f5e69-ed32-4a14-a42f-96b693df07e9 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:08.060791 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ae2f5e69-ed32-4a14-a42f-96b693df07e9 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:08.089386 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-dbd728bd-c60e-4a43-b8d1-71e6fa717fdd tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:08.089995 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-dbd728bd-c60e-4a43-b8d1-71e6fa717fdd tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 481c1d02-4070-4d58-8be2-438cd1a68eb5] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:08.100578 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-dbd728bd-c60e-4a43-b8d1-71e6fa717fdd tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:08.101074 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-dbd728bd-c60e-4a43-b8d1-71e6fa717fdd tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:08.101512 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-dbd728bd-c60e-4a43-b8d1-71e6fa717fdd tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:08.102230 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-dbd728bd-c60e-4a43-b8d1-71e6fa717fdd tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:08.102685 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-dbd728bd-c60e-4a43-b8d1-71e6fa717fdd tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:08.103111 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-dbd728bd-c60e-4a43-b8d1-71e6fa717fdd tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:08.552211 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-ae2f5e69-ed32-4a14-a42f-96b693df07e9 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:08.558592 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-dbd728bd-c60e-4a43-b8d1-71e6fa717fdd tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:08.564214 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-dbd728bd-c60e-4a43-b8d1-71e6fa717fdd tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5" status: 200 len: 1371 microversion: 2.1 time: 0.476622 Aug 11 11:06:08.564214 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 149/295] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:08 2022] GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5 => generated 1371 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:06:08.569450 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-ae2f5e69-ed32-4a14-a42f-96b693df07e9 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:08.570958 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-ae2f5e69-ed32-4a14-a42f-96b693df07e9 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:08.572164 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-ae2f5e69-ed32-4a14-a42f-96b693df07e9 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1742 microversion: 2.20 time: 0.526851 Aug 11 11:06:08.592808 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 147/296] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:06:08 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1742 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:06:08.625057 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-5bcc4796-5398-4cee-b4a5-6a06049bde5a tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-922328078", "imageRef": "05993162-aafd-4f1d-b781-ec09593713e5", "flavorRef": "452"}} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:06:08.691697 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.network.neutron [None req-5bcc4796-5398-4cee-b4a5-6a06049bde5a tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] validate_networks() for None {{(pid=121231) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 11 11:06:08.837643 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-55924807-aebd-4586-bb94-94553baa92bd tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:08.838698 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-55924807-aebd-4586-bb94-94553baa92bd tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:08.852692 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-55924807-aebd-4586-bb94-94553baa92bd tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:08.853206 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-55924807-aebd-4586-bb94-94553baa92bd tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:08.853650 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-55924807-aebd-4586-bb94-94553baa92bd tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:08.854417 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-55924807-aebd-4586-bb94-94553baa92bd tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:08.857319 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-55924807-aebd-4586-bb94-94553baa92bd tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:08.860222 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-55924807-aebd-4586-bb94-94553baa92bd tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:08.870027 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:09.140928 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-5bcc4796-5398-4cee-b4a5-6a06049bde5a tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Flavor limits 0:0:0 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 11 11:06:09.141714 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-5bcc4796-5398-4cee-b4a5-6a06049bde5a tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Image limits 0:0:0 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 11 11:06:09.142396 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-5bcc4796-5398-4cee-b4a5-6a06049bde5a tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Flavor pref 0:0:0 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 11 11:06:09.143040 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-55924807-aebd-4586-bb94-94553baa92bd tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:09.148591 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-5bcc4796-5398-4cee-b4a5-6a06049bde5a tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Image pref 0:0:0 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 11 11:06:09.149026 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-5bcc4796-5398-4cee-b4a5-6a06049bde5a tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 11 11:06:09.153260 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-55924807-aebd-4586-bb94-94553baa92bd tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1724 microversion: 2.1 time: 0.322044 Aug 11 11:06:09.165914 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5bcc4796-5398-4cee-b4a5-6a06049bde5a tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:09.166689 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5bcc4796-5398-4cee-b4a5-6a06049bde5a tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:09.168141 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5bcc4796-5398-4cee-b4a5-6a06049bde5a tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:09.168903 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5bcc4796-5398-4cee-b4a5-6a06049bde5a tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:09.169370 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5bcc4796-5398-4cee-b4a5-6a06049bde5a tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:09.169769 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5bcc4796-5398-4cee-b4a5-6a06049bde5a tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:09.170055 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 148/297] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:08 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1724 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:06:09.192236 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.quota [None req-5bcc4796-5398-4cee-b4a5-6a06049bde5a tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Getting quotas for project 83857835f34141f18a89c759631878f6. Resources: {'ram', 'cores', 'instances'} {{(pid=121231) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 11:06:09.197492 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.quota [None req-5bcc4796-5398-4cee-b4a5-6a06049bde5a tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Getting quotas for user c727b8f265774a4bb03d8425212e7540 and project 83857835f34141f18a89c759631878f6. Resources: {'ram', 'cores', 'instances'} {{(pid=121231) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 11:06:09.214343 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-5bcc4796-5398-4cee-b4a5-6a06049bde5a tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Going to run 1 instances... {{(pid=121231) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 11 11:06:09.217109 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-5bcc4796-5398-4cee-b4a5-6a06049bde5a tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] [instance: 0762660d-ef9c-4c5d-9f82-6d679b066641] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='05993162-aafd-4f1d-b781-ec09593713e5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121231) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 11 11:06:09.391210 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-5bcc4796-5398-4cee-b4a5-6a06049bde5a tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.770254 Aug 11 11:06:09.395846 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 150/298] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Aug 11 11:06:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 772 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 11 11:06:09.403792 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-bf38ea7f-6ed3-4393-950d-3820cbae6be6 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:09.404724 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-bf38ea7f-6ed3-4393-950d-3820cbae6be6 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] [instance: 0762660d-ef9c-4c5d-9f82-6d679b066641] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:09.480745 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-bf38ea7f-6ed3-4393-950d-3820cbae6be6 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c727b8f265774a4bb03d8425212e7540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83857835f34141f18a89c759631878f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:09.490730 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-bf38ea7f-6ed3-4393-950d-3820cbae6be6 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] 10.222.0.48 "GET /compute/v2.1/servers/0762660d-ef9c-4c5d-9f82-6d679b066641" status: 200 len: 1214 microversion: 2.1 time: 0.090772 Aug 11 11:06:09.496321 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 149/299] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:09 2022] GET /compute/v2.1/servers/0762660d-ef9c-4c5d-9f82-6d679b066641 => generated 1214 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:09.583507 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-0fd6f945-68a0-4dbd-919a-cb13526787c6 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:09.584243 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-0fd6f945-68a0-4dbd-919a-cb13526787c6 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 481c1d02-4070-4d58-8be2-438cd1a68eb5] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:09.606202 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-48303961-4b70-4fcd-9d4e-e14e80f66aeb tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:09.609359 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-48303961-4b70-4fcd-9d4e-e14e80f66aeb tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:09.614171 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0fd6f945-68a0-4dbd-919a-cb13526787c6 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:09.614867 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0fd6f945-68a0-4dbd-919a-cb13526787c6 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:09.615449 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0fd6f945-68a0-4dbd-919a-cb13526787c6 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:09.616363 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0fd6f945-68a0-4dbd-919a-cb13526787c6 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:09.617196 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0fd6f945-68a0-4dbd-919a-cb13526787c6 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:09.617786 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0fd6f945-68a0-4dbd-919a-cb13526787c6 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:09.618395 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-48303961-4b70-4fcd-9d4e-e14e80f66aeb tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:09.618889 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-48303961-4b70-4fcd-9d4e-e14e80f66aeb tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:09.619322 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-48303961-4b70-4fcd-9d4e-e14e80f66aeb tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:09.620043 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-48303961-4b70-4fcd-9d4e-e14e80f66aeb tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:09.624680 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-48303961-4b70-4fcd-9d4e-e14e80f66aeb tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:09.628367 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-48303961-4b70-4fcd-9d4e-e14e80f66aeb tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:09.871229 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-0fd6f945-68a0-4dbd-919a-cb13526787c6 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:09.878010 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-48303961-4b70-4fcd-9d4e-e14e80f66aeb tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:09.887112 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-48303961-4b70-4fcd-9d4e-e14e80f66aeb tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:09.888940 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-48303961-4b70-4fcd-9d4e-e14e80f66aeb tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:09.890156 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-48303961-4b70-4fcd-9d4e-e14e80f66aeb tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1742 microversion: 2.20 time: 0.292099 Aug 11 11:06:09.890974 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 150/300] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:06:09 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1742 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:06:09.913821 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-0fd6f945-68a0-4dbd-919a-cb13526787c6 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5" status: 200 len: 1564 microversion: 2.1 time: 0.333450 Aug 11 11:06:09.914850 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 151/301] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:09 2022] GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5 => generated 1564 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:09.947230 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-99a43cb9-11a0-42c1-9452-960b24ae1474 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:09.949360 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-99a43cb9-11a0-42c1-9452-960b24ae1474 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 481c1d02-4070-4d58-8be2-438cd1a68eb5] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:09.956472 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-99a43cb9-11a0-42c1-9452-960b24ae1474 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:09.957253 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-99a43cb9-11a0-42c1-9452-960b24ae1474 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:09.957861 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-99a43cb9-11a0-42c1-9452-960b24ae1474 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:09.959904 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-99a43cb9-11a0-42c1-9452-960b24ae1474 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:09.960552 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-99a43cb9-11a0-42c1-9452-960b24ae1474 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:09.960991 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-99a43cb9-11a0-42c1-9452-960b24ae1474 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:10.046751 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-99a43cb9-11a0-42c1-9452-960b24ae1474 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.114185 Aug 11 11:06:10.047390 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 151/302] 10.222.0.48 () {58 vars in 1275 bytes} [Thu Aug 11 11:06:09 2022] GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5/os-interface => generated 284 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:06:10.197846 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-caaa4e97-104e-4e81-b9d0-ef63910e0580 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:10.198781 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-caaa4e97-104e-4e81-b9d0-ef63910e0580 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:10.223520 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-caaa4e97-104e-4e81-b9d0-ef63910e0580 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:10.225603 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-caaa4e97-104e-4e81-b9d0-ef63910e0580 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:10.225603 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-caaa4e97-104e-4e81-b9d0-ef63910e0580 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:10.227330 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-caaa4e97-104e-4e81-b9d0-ef63910e0580 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:10.229070 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-caaa4e97-104e-4e81-b9d0-ef63910e0580 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:10.229765 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-caaa4e97-104e-4e81-b9d0-ef63910e0580 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:10.511103 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-caaa4e97-104e-4e81-b9d0-ef63910e0580 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:10.517445 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-d653279f-f510-485f-baa1-cc879fb66e13 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:10.521847 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-d653279f-f510-485f-baa1-cc879fb66e13 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] [instance: 0762660d-ef9c-4c5d-9f82-6d679b066641] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:10.542774 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-caaa4e97-104e-4e81-b9d0-ef63910e0580 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1724 microversion: 2.1 time: 0.370238 Aug 11 11:06:10.543395 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 152/303] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:10 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1724 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:06:10.602580 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d653279f-f510-485f-baa1-cc879fb66e13 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c727b8f265774a4bb03d8425212e7540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83857835f34141f18a89c759631878f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:10.610445 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-d653279f-f510-485f-baa1-cc879fb66e13 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] 10.222.0.48 "GET /compute/v2.1/servers/0762660d-ef9c-4c5d-9f82-6d679b066641" status: 200 len: 1214 microversion: 2.1 time: 0.097936 Aug 11 11:06:10.612212 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 152/304] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:10 2022] GET /compute/v2.1/servers/0762660d-ef9c-4c5d-9f82-6d679b066641 => generated 1214 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:06:10.682048 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-bc7b2952-055b-445f-8cea-1fe886e6251e req-ca97101d-c0da-4255-8c65-4e4d87ab37c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82a61cf6-1f3f-4ced-9806-a06252b9b2cc", "name": "network-vif-plugged", "status": "completed", "tag": "71bca2c4-19df-4dc2-ad61-c7058687c043"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:06:10.693910 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-bc7b2952-055b-445f-8cea-1fe886e6251e req-ca97101d-c0da-4255-8c65-4e4d87ab37c8 service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:10.694398 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-bc7b2952-055b-445f-8cea-1fe886e6251e req-ca97101d-c0da-4255-8c65-4e4d87ab37c8 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:10.695049 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-bc7b2952-055b-445f-8cea-1fe886e6251e req-ca97101d-c0da-4255-8c65-4e4d87ab37c8 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:10.711146 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-bc7b2952-055b-445f-8cea-1fe886e6251e req-ca97101d-c0da-4255-8c65-4e4d87ab37c8 service nova] Creating event network-vif-plugged:71bca2c4-19df-4dc2-ad61-c7058687c043 for instance 82a61cf6-1f3f-4ced-9806-a06252b9b2cc on hv-cinder-82002 Aug 11 11:06:10.716719 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-bc7b2952-055b-445f-8cea-1fe886e6251e req-ca97101d-c0da-4255-8c65-4e4d87ab37c8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038551 Aug 11 11:06:10.717740 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 153/305] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:06:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:06:10.915008 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-fecd2366-dd6f-47d4-b652-5f95b7431305 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:10.915557 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-fecd2366-dd6f-47d4-b652-5f95b7431305 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:10.921545 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fecd2366-dd6f-47d4-b652-5f95b7431305 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:10.922029 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fecd2366-dd6f-47d4-b652-5f95b7431305 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:10.922468 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fecd2366-dd6f-47d4-b652-5f95b7431305 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:10.923727 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fecd2366-dd6f-47d4-b652-5f95b7431305 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:10.924207 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fecd2366-dd6f-47d4-b652-5f95b7431305 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:10.924630 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fecd2366-dd6f-47d4-b652-5f95b7431305 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:11.079740 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-fecd2366-dd6f-47d4-b652-5f95b7431305 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:11.087690 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-fecd2366-dd6f-47d4-b652-5f95b7431305 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:11.089226 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-fecd2366-dd6f-47d4-b652-5f95b7431305 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:11.090380 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-fecd2366-dd6f-47d4-b652-5f95b7431305 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1737 microversion: 2.20 time: 0.179444 Aug 11 11:06:11.090948 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 153/306] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:06:10 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1737 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:06:11.592889 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-6111253e-eb58-4ec7-a86e-af22b84170f2 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:11.593449 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-6111253e-eb58-4ec7-a86e-af22b84170f2 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:11.615012 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6111253e-eb58-4ec7-a86e-af22b84170f2 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:11.615658 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6111253e-eb58-4ec7-a86e-af22b84170f2 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:11.616190 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6111253e-eb58-4ec7-a86e-af22b84170f2 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:11.617041 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6111253e-eb58-4ec7-a86e-af22b84170f2 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:11.617588 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6111253e-eb58-4ec7-a86e-af22b84170f2 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:11.618220 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6111253e-eb58-4ec7-a86e-af22b84170f2 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:11.641853 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-c7a44fe3-e9c5-4b4b-bcc0-ba347fd5d571 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:11.642875 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-c7a44fe3-e9c5-4b4b-bcc0-ba347fd5d571 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] [instance: 0762660d-ef9c-4c5d-9f82-6d679b066641] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:11.658343 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c7a44fe3-e9c5-4b4b-bcc0-ba347fd5d571 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:11.658847 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c7a44fe3-e9c5-4b4b-bcc0-ba347fd5d571 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:11.659285 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c7a44fe3-e9c5-4b4b-bcc0-ba347fd5d571 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:11.662374 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c7a44fe3-e9c5-4b4b-bcc0-ba347fd5d571 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:11.666788 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c7a44fe3-e9c5-4b4b-bcc0-ba347fd5d571 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:11.666788 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c7a44fe3-e9c5-4b4b-bcc0-ba347fd5d571 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:11.768346 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-c7a44fe3-e9c5-4b4b-bcc0-ba347fd5d571 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c727b8f265774a4bb03d8425212e7540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83857835f34141f18a89c759631878f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:11.778841 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-c7a44fe3-e9c5-4b4b-bcc0-ba347fd5d571 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] 10.222.0.48 "GET /compute/v2.1/servers/0762660d-ef9c-4c5d-9f82-6d679b066641" status: 200 len: 1218 microversion: 2.1 time: 0.141489 Aug 11 11:06:11.781546 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 154/307] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:11 2022] GET /compute/v2.1/servers/0762660d-ef9c-4c5d-9f82-6d679b066641 => generated 1218 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:06:11.867602 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-6111253e-eb58-4ec7-a86e-af22b84170f2 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:11.879075 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-6111253e-eb58-4ec7-a86e-af22b84170f2 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1724 microversion: 2.1 time: 0.296144 Aug 11 11:06:11.892083 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 154/308] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:11 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1724 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:12.031967 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-f1492dd6-2c96-4514-94ae-b21195bc30d4 req-c66e6dcd-e65e-4623-9a84-240017e62fae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "481c1d02-4070-4d58-8be2-438cd1a68eb5", "tag": "9c6e465a-0bd3-4725-9e9b-81120495670d"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:06:12.045146 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-f1492dd6-2c96-4514-94ae-b21195bc30d4 req-c66e6dcd-e65e-4623-9a84-240017e62fae service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:12.045631 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-f1492dd6-2c96-4514-94ae-b21195bc30d4 req-c66e6dcd-e65e-4623-9a84-240017e62fae service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:12.046064 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-f1492dd6-2c96-4514-94ae-b21195bc30d4 req-c66e6dcd-e65e-4623-9a84-240017e62fae service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:12.072967 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-f1492dd6-2c96-4514-94ae-b21195bc30d4 req-c66e6dcd-e65e-4623-9a84-240017e62fae service nova] Creating event network-changed:9c6e465a-0bd3-4725-9e9b-81120495670d for instance 481c1d02-4070-4d58-8be2-438cd1a68eb5 on hv-cinder-82002 Aug 11 11:06:12.079537 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-f1492dd6-2c96-4514-94ae-b21195bc30d4 req-c66e6dcd-e65e-4623-9a84-240017e62fae service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052967 Aug 11 11:06:12.080550 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 155/309] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:06:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:06:12.114877 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-f383bd38-d28c-45b1-861c-fe80d333ebb1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:12.115261 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-f383bd38-d28c-45b1-861c-fe80d333ebb1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:12.124909 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f383bd38-d28c-45b1-861c-fe80d333ebb1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:12.125402 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f383bd38-d28c-45b1-861c-fe80d333ebb1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:12.126408 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f383bd38-d28c-45b1-861c-fe80d333ebb1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:12.132969 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f383bd38-d28c-45b1-861c-fe80d333ebb1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:12.134972 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f383bd38-d28c-45b1-861c-fe80d333ebb1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:12.135942 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f383bd38-d28c-45b1-861c-fe80d333ebb1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:12.468988 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-f383bd38-d28c-45b1-861c-fe80d333ebb1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:12.480466 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-f383bd38-d28c-45b1-861c-fe80d333ebb1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:12.483966 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-f383bd38-d28c-45b1-861c-fe80d333ebb1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:12.490299 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-f383bd38-d28c-45b1-861c-fe80d333ebb1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1737 microversion: 2.20 time: 0.380499 Aug 11 11:06:12.494850 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 155/310] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:06:12 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1737 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:06:12.807449 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-80547556-71cb-4f9a-a9af-1cdeebdc565d tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:12.808144 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-80547556-71cb-4f9a-a9af-1cdeebdc565d tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] [instance: 0762660d-ef9c-4c5d-9f82-6d679b066641] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:12.820292 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-80547556-71cb-4f9a-a9af-1cdeebdc565d tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:12.821482 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-80547556-71cb-4f9a-a9af-1cdeebdc565d tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:12.822281 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-80547556-71cb-4f9a-a9af-1cdeebdc565d tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:12.823225 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-80547556-71cb-4f9a-a9af-1cdeebdc565d tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:12.823940 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-80547556-71cb-4f9a-a9af-1cdeebdc565d tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:12.824531 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-80547556-71cb-4f9a-a9af-1cdeebdc565d tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:12.893112 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-1f57ea6e-b7f0-4a1e-aa15-de0d5255fa32 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Action: 'create', calling method: .version_select at 0x7faab0da2ca0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-869976892", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE5gdPCG2Z/SyldSG9pLXFMnxYv10T7fdegXcBG+dSnUGVvZteYpgQXhPXWoSrl8K2QRYCLor0du1xR1AR6xydJli1ekeqE0YMAeNADGGRvRnnv0+kJRQmDzR554pIVLRQ=="}} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:06:12.913290 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.quota [None req-1f57ea6e-b7f0-4a1e-aa15-de0d5255fa32 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Getting quotas for project 233f1c55781b4099be6e250e664c4fb9. Resources: {'key_pairs'} {{(pid=121231) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 11:06:12.923878 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.quota [None req-1f57ea6e-b7f0-4a1e-aa15-de0d5255fa32 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Getting quotas for user dfaf5a716c5b448f8e1274de2fad307c and project 233f1c55781b4099be6e250e664c4fb9. Resources: {'key_pairs'} {{(pid=121231) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 11:06:12.963941 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-80547556-71cb-4f9a-a9af-1cdeebdc565d tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c727b8f265774a4bb03d8425212e7540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83857835f34141f18a89c759631878f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:12.979610 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-80547556-71cb-4f9a-a9af-1cdeebdc565d tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] 10.222.0.48 "GET /compute/v2.1/servers/0762660d-ef9c-4c5d-9f82-6d679b066641" status: 200 len: 1210 microversion: 2.1 time: 0.176724 Aug 11 11:06:12.990351 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 156/311] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:12 2022] GET /compute/v2.1/servers/0762660d-ef9c-4c5d-9f82-6d679b066641 => generated 1210 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:13.008508 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-d1f34147-dade-43c2-a230-87590ab45279 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:13.009277 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-d1f34147-dade-43c2-a230-87590ab45279 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:13.017013 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d1f34147-dade-43c2-a230-87590ab45279 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:13.017500 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d1f34147-dade-43c2-a230-87590ab45279 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:13.017929 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d1f34147-dade-43c2-a230-87590ab45279 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:13.018623 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d1f34147-dade-43c2-a230-87590ab45279 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:13.019108 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d1f34147-dade-43c2-a230-87590ab45279 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:13.019527 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d1f34147-dade-43c2-a230-87590ab45279 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:13.058411 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-1f57ea6e-b7f0-4a1e-aa15-de0d5255fa32 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.172951 Aug 11 11:06:13.059512 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 156/312] 10.222.0.48 () {60 vars in 1159 bytes} [Thu Aug 11 11:06:12 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:06:13.224904 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-0e01c806-3d50-4b57-ad3c-6c34a25a5d38 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1423887493", "imageRef": "505df1ee-29cd-4bc2-bf59-fc3668743d3d", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-869976892", "networks": [{"uuid": "15ed978d-c013-463f-b8a2-153c45fa4fe8"}]}} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:06:13.234386 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d1f34147-dade-43c2-a230-87590ab45279 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:13.242724 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-d1f34147-dade-43c2-a230-87590ab45279 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1724 microversion: 2.1 time: 0.238092 Aug 11 11:06:13.243317 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 157/313] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:12 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1724 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:13.300065 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.network.neutron [None req-0e01c806-3d50-4b57-ad3c-6c34a25a5d38 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] validate_networks() for [('15ed978d-c013-463f-b8a2-153c45fa4fe8', None, None, None, None, None)] {{(pid=121231) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 11 11:06:13.521991 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-030f0660-1964-4053-b36c-1048ee12aba1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:13.523381 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-030f0660-1964-4053-b36c-1048ee12aba1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:13.531433 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-030f0660-1964-4053-b36c-1048ee12aba1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:13.533216 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-030f0660-1964-4053-b36c-1048ee12aba1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:13.533216 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-030f0660-1964-4053-b36c-1048ee12aba1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:13.533511 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-030f0660-1964-4053-b36c-1048ee12aba1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:13.534218 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-030f0660-1964-4053-b36c-1048ee12aba1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:13.534903 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-030f0660-1964-4053-b36c-1048ee12aba1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:13.971554 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-030f0660-1964-4053-b36c-1048ee12aba1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:13.984108 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-030f0660-1964-4053-b36c-1048ee12aba1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:13.989187 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-030f0660-1964-4053-b36c-1048ee12aba1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:13.995583 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-030f0660-1964-4053-b36c-1048ee12aba1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1737 microversion: 2.20 time: 0.482594 Aug 11 11:06:13.999070 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 158/314] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:06:13 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1737 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:06:14.017882 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-25df9124-5647-4cd4-9b45-6a06a1c8c43d tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:14.020390 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-25df9124-5647-4cd4-9b45-6a06a1c8c43d tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] [instance: 0762660d-ef9c-4c5d-9f82-6d679b066641] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:14.026927 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-25df9124-5647-4cd4-9b45-6a06a1c8c43d tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:14.028562 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-25df9124-5647-4cd4-9b45-6a06a1c8c43d tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:14.029083 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-25df9124-5647-4cd4-9b45-6a06a1c8c43d tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:14.030002 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-25df9124-5647-4cd4-9b45-6a06a1c8c43d tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:14.030559 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-25df9124-5647-4cd4-9b45-6a06a1c8c43d tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:14.031080 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-25df9124-5647-4cd4-9b45-6a06a1c8c43d tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:14.122893 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-25df9124-5647-4cd4-9b45-6a06a1c8c43d tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c727b8f265774a4bb03d8425212e7540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83857835f34141f18a89c759631878f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:14.131366 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-25df9124-5647-4cd4-9b45-6a06a1c8c43d tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] 10.222.0.48 "GET /compute/v2.1/servers/0762660d-ef9c-4c5d-9f82-6d679b066641" status: 200 len: 1274 microversion: 2.1 time: 0.118041 Aug 11 11:06:14.133048 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 159/315] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:14 2022] GET /compute/v2.1/servers/0762660d-ef9c-4c5d-9f82-6d679b066641 => generated 1274 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:14.177681 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-0e01c806-3d50-4b57-ad3c-6c34a25a5d38 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Flavor limits 0:0:0 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 11 11:06:14.180335 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-0e01c806-3d50-4b57-ad3c-6c34a25a5d38 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Image limits 0:0:0 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 11 11:06:14.180335 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-0e01c806-3d50-4b57-ad3c-6c34a25a5d38 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Flavor pref 0:0:0 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 11 11:06:14.180335 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-0e01c806-3d50-4b57-ad3c-6c34a25a5d38 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Image pref 0:0:0 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 11 11:06:14.180577 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-0e01c806-3d50-4b57-ad3c-6c34a25a5d38 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 11 11:06:14.221512 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0e01c806-3d50-4b57-ad3c-6c34a25a5d38 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:14.223203 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0e01c806-3d50-4b57-ad3c-6c34a25a5d38 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:14.224390 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0e01c806-3d50-4b57-ad3c-6c34a25a5d38 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:14.227259 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0e01c806-3d50-4b57-ad3c-6c34a25a5d38 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:14.227970 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0e01c806-3d50-4b57-ad3c-6c34a25a5d38 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:14.231228 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0e01c806-3d50-4b57-ad3c-6c34a25a5d38 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:14.269949 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-911b83bd-af85-413b-9fb4-38752a2ad1e8 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:14.271468 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-911b83bd-af85-413b-9fb4-38752a2ad1e8 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:14.292039 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-911b83bd-af85-413b-9fb4-38752a2ad1e8 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:14.293826 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-911b83bd-af85-413b-9fb4-38752a2ad1e8 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:14.294557 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-911b83bd-af85-413b-9fb4-38752a2ad1e8 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:14.296630 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-911b83bd-af85-413b-9fb4-38752a2ad1e8 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:14.297072 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.quota [None req-0e01c806-3d50-4b57-ad3c-6c34a25a5d38 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Getting quotas for project 233f1c55781b4099be6e250e664c4fb9. Resources: {'ram', 'cores', 'instances'} {{(pid=121231) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 11:06:14.298861 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-911b83bd-af85-413b-9fb4-38752a2ad1e8 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:14.299971 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-911b83bd-af85-413b-9fb4-38752a2ad1e8 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:14.310017 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.quota [None req-0e01c806-3d50-4b57-ad3c-6c34a25a5d38 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Getting quotas for user dfaf5a716c5b448f8e1274de2fad307c and project 233f1c55781b4099be6e250e664c4fb9. Resources: {'ram', 'cores', 'instances'} {{(pid=121231) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 11:06:14.325050 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:14.328168 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-0e01c806-3d50-4b57-ad3c-6c34a25a5d38 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Going to run 1 instances... {{(pid=121231) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 11 11:06:14.330680 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-0e01c806-3d50-4b57-ad3c-6c34a25a5d38 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] [instance: 3794302e-1657-4edd-9e15-a78592597d5b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='505df1ee-29cd-4bc2-bf59-fc3668743d3d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121231) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 11 11:06:14.446151 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-0e01c806-3d50-4b57-ad3c-6c34a25a5d38 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.225710 Aug 11 11:06:14.446898 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 157/316] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Aug 11 11:06:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1227 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 11 11:06:14.471966 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-86acd52e-e427-46f3-9673-c541d68cead0 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:14.476021 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-86acd52e-e427-46f3-9673-c541d68cead0 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] [instance: 3794302e-1657-4edd-9e15-a78592597d5b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:14.816542 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-86acd52e-e427-46f3-9673-c541d68cead0 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfaf5a716c5b448f8e1274de2fad307c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233f1c55781b4099be6e250e664c4fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:14.837830 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-86acd52e-e427-46f3-9673-c541d68cead0 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] 10.222.0.48 "GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b" status: 200 len: 1258 microversion: 2.1 time: 0.382076 Aug 11 11:06:14.863418 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 158/317] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:14 2022] GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b => generated 1258 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:14.907696 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-911b83bd-af85-413b-9fb4-38752a2ad1e8 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:14.916775 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-911b83bd-af85-413b-9fb4-38752a2ad1e8 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1724 microversion: 2.1 time: 0.656243 Aug 11 11:06:14.931011 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 160/318] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:14 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1724 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:15.022408 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-9e1ebb90-2eeb-4ee1-9b9e-27d00b1a5f78 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:15.023006 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-9e1ebb90-2eeb-4ee1-9b9e-27d00b1a5f78 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:15.029687 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9e1ebb90-2eeb-4ee1-9b9e-27d00b1a5f78 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:15.030322 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9e1ebb90-2eeb-4ee1-9b9e-27d00b1a5f78 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:15.030761 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9e1ebb90-2eeb-4ee1-9b9e-27d00b1a5f78 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:15.032219 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9e1ebb90-2eeb-4ee1-9b9e-27d00b1a5f78 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:15.032886 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9e1ebb90-2eeb-4ee1-9b9e-27d00b1a5f78 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:15.033487 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9e1ebb90-2eeb-4ee1-9b9e-27d00b1a5f78 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:15.160654 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-ce36d45b-d1f9-48a6-a028-3f1e74be890e tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:15.162621 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-ce36d45b-d1f9-48a6-a028-3f1e74be890e tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] [instance: 0762660d-ef9c-4c5d-9f82-6d679b066641] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:15.173295 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ce36d45b-d1f9-48a6-a028-3f1e74be890e tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:15.174280 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ce36d45b-d1f9-48a6-a028-3f1e74be890e tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:15.176048 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ce36d45b-d1f9-48a6-a028-3f1e74be890e tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:15.177304 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ce36d45b-d1f9-48a6-a028-3f1e74be890e tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:15.179650 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ce36d45b-d1f9-48a6-a028-3f1e74be890e tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:15.182496 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ce36d45b-d1f9-48a6-a028-3f1e74be890e tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:15.349198 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-ce36d45b-d1f9-48a6-a028-3f1e74be890e tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c727b8f265774a4bb03d8425212e7540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83857835f34141f18a89c759631878f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:15.354674 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-9e1ebb90-2eeb-4ee1-9b9e-27d00b1a5f78 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:15.363348 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-ce36d45b-d1f9-48a6-a028-3f1e74be890e tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] 10.222.0.48 "GET /compute/v2.1/servers/0762660d-ef9c-4c5d-9f82-6d679b066641" status: 200 len: 1272 microversion: 2.1 time: 0.207030 Aug 11 11:06:15.364242 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 161/319] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:15 2022] GET /compute/v2.1/servers/0762660d-ef9c-4c5d-9f82-6d679b066641 => generated 1272 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:06:15.368374 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-9e1ebb90-2eeb-4ee1-9b9e-27d00b1a5f78 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:15.370213 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-9e1ebb90-2eeb-4ee1-9b9e-27d00b1a5f78 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:15.374029 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-9e1ebb90-2eeb-4ee1-9b9e-27d00b1a5f78 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1737 microversion: 2.20 time: 0.356246 Aug 11 11:06:15.380106 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 159/320] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:06:15 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1737 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:06:15.921669 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-6950d4f9-c5b6-43a0-876b-33c3b051f084 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:15.921669 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-6950d4f9-c5b6-43a0-876b-33c3b051f084 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] [instance: 3794302e-1657-4edd-9e15-a78592597d5b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:15.921669 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-6950d4f9-c5b6-43a0-876b-33c3b051f084 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfaf5a716c5b448f8e1274de2fad307c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233f1c55781b4099be6e250e664c4fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:15.938415 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-6950d4f9-c5b6-43a0-876b-33c3b051f084 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] 10.222.0.48 "GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b" status: 200 len: 1258 microversion: 2.1 time: 0.083229 Aug 11 11:06:15.939140 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-2b2ecc2a-05bd-4aaf-958a-a1c5a160fbd6 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:15.939301 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 162/321] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:15 2022] GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b => generated 1258 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:15.940119 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-2b2ecc2a-05bd-4aaf-958a-a1c5a160fbd6 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:15.960714 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2b2ecc2a-05bd-4aaf-958a-a1c5a160fbd6 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:15.961294 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2b2ecc2a-05bd-4aaf-958a-a1c5a160fbd6 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:15.961772 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2b2ecc2a-05bd-4aaf-958a-a1c5a160fbd6 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:15.962502 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2b2ecc2a-05bd-4aaf-958a-a1c5a160fbd6 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:15.962965 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2b2ecc2a-05bd-4aaf-958a-a1c5a160fbd6 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:15.963394 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2b2ecc2a-05bd-4aaf-958a-a1c5a160fbd6 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:16.118792 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-2b2ecc2a-05bd-4aaf-958a-a1c5a160fbd6 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:16.127444 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-2b2ecc2a-05bd-4aaf-958a-a1c5a160fbd6 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1724 microversion: 2.1 time: 0.192607 Aug 11 11:06:16.128045 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 160/322] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:15 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1724 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:06:16.387941 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-bbec5af2-4c6a-4d26-bd5a-0800c86680e3 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:16.388579 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-bbec5af2-4c6a-4d26-bd5a-0800c86680e3 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] [instance: 0762660d-ef9c-4c5d-9f82-6d679b066641] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:16.395383 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bbec5af2-4c6a-4d26-bd5a-0800c86680e3 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:16.395899 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bbec5af2-4c6a-4d26-bd5a-0800c86680e3 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:16.396329 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bbec5af2-4c6a-4d26-bd5a-0800c86680e3 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:16.397015 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bbec5af2-4c6a-4d26-bd5a-0800c86680e3 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:16.397460 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bbec5af2-4c6a-4d26-bd5a-0800c86680e3 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:16.397944 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bbec5af2-4c6a-4d26-bd5a-0800c86680e3 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:16.400315 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-f51ddde8-9b52-4fca-a813-9099d4656a66 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:16.400927 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-f51ddde8-9b52-4fca-a813-9099d4656a66 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:16.407112 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f51ddde8-9b52-4fca-a813-9099d4656a66 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:16.407589 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f51ddde8-9b52-4fca-a813-9099d4656a66 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:16.408054 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f51ddde8-9b52-4fca-a813-9099d4656a66 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:16.408743 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f51ddde8-9b52-4fca-a813-9099d4656a66 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:16.409192 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f51ddde8-9b52-4fca-a813-9099d4656a66 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:16.409619 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f51ddde8-9b52-4fca-a813-9099d4656a66 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:16.479394 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-bbec5af2-4c6a-4d26-bd5a-0800c86680e3 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c727b8f265774a4bb03d8425212e7540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83857835f34141f18a89c759631878f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:16.487387 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-bbec5af2-4c6a-4d26-bd5a-0800c86680e3 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] 10.222.0.48 "GET /compute/v2.1/servers/0762660d-ef9c-4c5d-9f82-6d679b066641" status: 200 len: 1272 microversion: 2.1 time: 0.103557 Aug 11 11:06:16.487987 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 163/323] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:16 2022] GET /compute/v2.1/servers/0762660d-ef9c-4c5d-9f82-6d679b066641 => generated 1272 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:16.568992 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-f51ddde8-9b52-4fca-a813-9099d4656a66 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:16.580357 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-f51ddde8-9b52-4fca-a813-9099d4656a66 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:16.580357 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-f51ddde8-9b52-4fca-a813-9099d4656a66 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:16.580357 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-f51ddde8-9b52-4fca-a813-9099d4656a66 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1737 microversion: 2.20 time: 0.183161 Aug 11 11:06:16.580733 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 161/324] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:06:16 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1737 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 11:06:16.968450 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-653d96eb-618e-454c-8fa3-6c91f409b22a tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:16.969626 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-653d96eb-618e-454c-8fa3-6c91f409b22a tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] [instance: 3794302e-1657-4edd-9e15-a78592597d5b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:17.035348 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-653d96eb-618e-454c-8fa3-6c91f409b22a tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfaf5a716c5b448f8e1274de2fad307c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233f1c55781b4099be6e250e664c4fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:17.043377 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-653d96eb-618e-454c-8fa3-6c91f409b22a tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] 10.222.0.48 "GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b" status: 200 len: 1258 microversion: 2.1 time: 0.080981 Aug 11 11:06:17.044957 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 164/325] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:16 2022] GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b => generated 1258 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:17.151870 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-22b1ec22-db92-4638-a4f7-03370593307c tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:17.151870 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-22b1ec22-db92-4638-a4f7-03370593307c tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:17.159031 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-22b1ec22-db92-4638-a4f7-03370593307c tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:17.159516 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-22b1ec22-db92-4638-a4f7-03370593307c tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:17.159981 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-22b1ec22-db92-4638-a4f7-03370593307c tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:17.161289 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-22b1ec22-db92-4638-a4f7-03370593307c tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:17.161906 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-22b1ec22-db92-4638-a4f7-03370593307c tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:17.165140 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-22b1ec22-db92-4638-a4f7-03370593307c tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:17.354661 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-22b1ec22-db92-4638-a4f7-03370593307c tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:17.367492 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-22b1ec22-db92-4638-a4f7-03370593307c tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1724 microversion: 2.1 time: 0.221007 Aug 11 11:06:17.368665 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 162/326] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:17 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1724 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:17.508443 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-16f35f18-9a17-4eef-a625-9d12ae5adbb4 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:17.509172 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-16f35f18-9a17-4eef-a625-9d12ae5adbb4 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] [instance: 0762660d-ef9c-4c5d-9f82-6d679b066641] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:17.515494 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-16f35f18-9a17-4eef-a625-9d12ae5adbb4 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:17.516886 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-16f35f18-9a17-4eef-a625-9d12ae5adbb4 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:17.517576 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-16f35f18-9a17-4eef-a625-9d12ae5adbb4 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:17.518406 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-16f35f18-9a17-4eef-a625-9d12ae5adbb4 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:17.518931 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-16f35f18-9a17-4eef-a625-9d12ae5adbb4 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:17.519445 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-16f35f18-9a17-4eef-a625-9d12ae5adbb4 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:17.606939 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-622c805f-5c85-45d9-87dc-4c55a8ee836e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:17.608318 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-622c805f-5c85-45d9-87dc-4c55a8ee836e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:17.614987 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-622c805f-5c85-45d9-87dc-4c55a8ee836e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:17.615803 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-622c805f-5c85-45d9-87dc-4c55a8ee836e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:17.616452 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-622c805f-5c85-45d9-87dc-4c55a8ee836e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:17.617384 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-622c805f-5c85-45d9-87dc-4c55a8ee836e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:17.618173 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-622c805f-5c85-45d9-87dc-4c55a8ee836e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:17.618795 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-622c805f-5c85-45d9-87dc-4c55a8ee836e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:17.741277 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-16f35f18-9a17-4eef-a625-9d12ae5adbb4 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c727b8f265774a4bb03d8425212e7540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83857835f34141f18a89c759631878f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:17.751000 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-16f35f18-9a17-4eef-a625-9d12ae5adbb4 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] 10.222.0.48 "GET /compute/v2.1/servers/0762660d-ef9c-4c5d-9f82-6d679b066641" status: 200 len: 1314 microversion: 2.1 time: 0.245774 Aug 11 11:06:17.765076 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 165/327] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:17 2022] GET /compute/v2.1/servers/0762660d-ef9c-4c5d-9f82-6d679b066641 => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:17.804868 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-622c805f-5c85-45d9-87dc-4c55a8ee836e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:17.814102 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-622c805f-5c85-45d9-87dc-4c55a8ee836e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:17.832941 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-622c805f-5c85-45d9-87dc-4c55a8ee836e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:17.832941 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-622c805f-5c85-45d9-87dc-4c55a8ee836e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1737 microversion: 2.20 time: 0.221820 Aug 11 11:06:17.833809 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 163/328] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:06:17 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1737 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:06:18.065385 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-834233e9-0fdf-40eb-a919-99f2116cd55b tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:18.066498 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-834233e9-0fdf-40eb-a919-99f2116cd55b tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] [instance: 3794302e-1657-4edd-9e15-a78592597d5b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:18.084469 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-834233e9-0fdf-40eb-a919-99f2116cd55b tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:18.085777 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-834233e9-0fdf-40eb-a919-99f2116cd55b tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:18.086592 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-834233e9-0fdf-40eb-a919-99f2116cd55b tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:18.087507 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-834233e9-0fdf-40eb-a919-99f2116cd55b tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:18.091018 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-834233e9-0fdf-40eb-a919-99f2116cd55b tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:18.095194 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-834233e9-0fdf-40eb-a919-99f2116cd55b tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:18.201159 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-834233e9-0fdf-40eb-a919-99f2116cd55b tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfaf5a716c5b448f8e1274de2fad307c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233f1c55781b4099be6e250e664c4fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:18.209212 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-834233e9-0fdf-40eb-a919-99f2116cd55b tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] 10.222.0.48 "GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b" status: 200 len: 1262 microversion: 2.1 time: 0.148533 Aug 11 11:06:18.212838 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 166/329] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:18 2022] GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b => generated 1262 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:18.389202 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-b52b2f3c-f5d2-4f90-817f-d3368d10c46b tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:18.389823 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-b52b2f3c-f5d2-4f90-817f-d3368d10c46b tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:18.406645 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b52b2f3c-f5d2-4f90-817f-d3368d10c46b tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:18.407596 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b52b2f3c-f5d2-4f90-817f-d3368d10c46b tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:18.411418 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b52b2f3c-f5d2-4f90-817f-d3368d10c46b tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:18.411418 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b52b2f3c-f5d2-4f90-817f-d3368d10c46b tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:18.411418 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b52b2f3c-f5d2-4f90-817f-d3368d10c46b tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:18.411418 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b52b2f3c-f5d2-4f90-817f-d3368d10c46b tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:18.414471 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell1:SELECT=100 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:18.642923 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-b52b2f3c-f5d2-4f90-817f-d3368d10c46b tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:18.663225 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-b52b2f3c-f5d2-4f90-817f-d3368d10c46b tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1724 microversion: 2.1 time: 0.277714 Aug 11 11:06:18.665822 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 164/330] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:18 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1724 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:06:18.773841 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-e8e4067f-7122-49b6-93a1-e668deecd6f2 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:18.775291 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-e8e4067f-7122-49b6-93a1-e668deecd6f2 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] [instance: 0762660d-ef9c-4c5d-9f82-6d679b066641] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:18.782749 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:18.784580 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e8e4067f-7122-49b6-93a1-e668deecd6f2 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:18.788297 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e8e4067f-7122-49b6-93a1-e668deecd6f2 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:18.788297 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e8e4067f-7122-49b6-93a1-e668deecd6f2 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:18.788297 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e8e4067f-7122-49b6-93a1-e668deecd6f2 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:18.788297 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e8e4067f-7122-49b6-93a1-e668deecd6f2 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:18.788639 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e8e4067f-7122-49b6-93a1-e668deecd6f2 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:18.845564 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-1a71429f-5f02-4342-926f-8a92a14e94ea tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:18.846538 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-1a71429f-5f02-4342-926f-8a92a14e94ea tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:18.871742 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1a71429f-5f02-4342-926f-8a92a14e94ea tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:18.871742 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1a71429f-5f02-4342-926f-8a92a14e94ea tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:18.871742 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1a71429f-5f02-4342-926f-8a92a14e94ea tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:18.872465 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1a71429f-5f02-4342-926f-8a92a14e94ea tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:18.872996 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1a71429f-5f02-4342-926f-8a92a14e94ea tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:18.873489 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1a71429f-5f02-4342-926f-8a92a14e94ea tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:19.066677 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-e8e4067f-7122-49b6-93a1-e668deecd6f2 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c727b8f265774a4bb03d8425212e7540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83857835f34141f18a89c759631878f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:19.079238 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-e8e4067f-7122-49b6-93a1-e668deecd6f2 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] 10.222.0.48 "GET /compute/v2.1/servers/0762660d-ef9c-4c5d-9f82-6d679b066641" status: 200 len: 1314 microversion: 2.1 time: 0.310496 Aug 11 11:06:19.099853 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 167/331] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:18 2022] GET /compute/v2.1/servers/0762660d-ef9c-4c5d-9f82-6d679b066641 => generated 1314 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:19.194117 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-1a71429f-5f02-4342-926f-8a92a14e94ea tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:19.202851 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-1a71429f-5f02-4342-926f-8a92a14e94ea tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:19.205324 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-1a71429f-5f02-4342-926f-8a92a14e94ea tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:19.205857 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-1a71429f-5f02-4342-926f-8a92a14e94ea tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1737 microversion: 2.20 time: 0.364430 Aug 11 11:06:19.206671 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 165/332] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:06:18 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1737 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 11:06:19.233141 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-f3c10d5a-a214-4ac4-b40a-f32438ce5f72 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:19.233745 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-f3c10d5a-a214-4ac4-b40a-f32438ce5f72 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] [instance: 3794302e-1657-4edd-9e15-a78592597d5b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:19.240523 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f3c10d5a-a214-4ac4-b40a-f32438ce5f72 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:19.241212 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f3c10d5a-a214-4ac4-b40a-f32438ce5f72 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:19.241643 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f3c10d5a-a214-4ac4-b40a-f32438ce5f72 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:19.242487 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f3c10d5a-a214-4ac4-b40a-f32438ce5f72 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:19.243087 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f3c10d5a-a214-4ac4-b40a-f32438ce5f72 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:19.243676 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f3c10d5a-a214-4ac4-b40a-f32438ce5f72 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:19.318608 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-f3c10d5a-a214-4ac4-b40a-f32438ce5f72 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfaf5a716c5b448f8e1274de2fad307c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233f1c55781b4099be6e250e664c4fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:19.328220 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-f3c10d5a-a214-4ac4-b40a-f32438ce5f72 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] 10.222.0.48 "GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b" status: 200 len: 1310 microversion: 2.1 time: 0.098861 Aug 11 11:06:19.329022 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 168/333] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:19 2022] GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b => generated 1310 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:19.385606 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-3d23b7db-6b46-4220-a478-f7df7f66831c req-69b9c4ac-20ba-42ef-95c3-e23904d3f455 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0762660d-ef9c-4c5d-9f82-6d679b066641", "tag": "0b55ba06-1442-4212-8bed-52450c407f97"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:06:19.401510 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-3d23b7db-6b46-4220-a478-f7df7f66831c req-69b9c4ac-20ba-42ef-95c3-e23904d3f455 service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:19.401997 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-3d23b7db-6b46-4220-a478-f7df7f66831c req-69b9c4ac-20ba-42ef-95c3-e23904d3f455 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:19.405021 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-3d23b7db-6b46-4220-a478-f7df7f66831c req-69b9c4ac-20ba-42ef-95c3-e23904d3f455 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:19.435278 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-3d23b7db-6b46-4220-a478-f7df7f66831c req-69b9c4ac-20ba-42ef-95c3-e23904d3f455 service nova] Creating event network-changed:0b55ba06-1442-4212-8bed-52450c407f97 for instance 0762660d-ef9c-4c5d-9f82-6d679b066641 on hv-cinder-82002 Aug 11 11:06:19.449485 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-3d23b7db-6b46-4220-a478-f7df7f66831c req-69b9c4ac-20ba-42ef-95c3-e23904d3f455 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066786 Aug 11 11:06:19.452100 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 166/334] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:06:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:06:19.695845 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-694322c0-cdb0-44a1-b44c-1350fe9fc247 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:19.695845 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-694322c0-cdb0-44a1-b44c-1350fe9fc247 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:19.697525 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-694322c0-cdb0-44a1-b44c-1350fe9fc247 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:19.698031 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-694322c0-cdb0-44a1-b44c-1350fe9fc247 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:19.698470 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-694322c0-cdb0-44a1-b44c-1350fe9fc247 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:19.699175 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-694322c0-cdb0-44a1-b44c-1350fe9fc247 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:19.702428 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-694322c0-cdb0-44a1-b44c-1350fe9fc247 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:19.704250 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-694322c0-cdb0-44a1-b44c-1350fe9fc247 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:20.096381 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-694322c0-cdb0-44a1-b44c-1350fe9fc247 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:20.101193 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=100 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:20.106924 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-694322c0-cdb0-44a1-b44c-1350fe9fc247 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1724 microversion: 2.1 time: 0.424389 Aug 11 11:06:20.121784 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 169/335] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:19 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1724 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:20.122050 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-c018bd71-9399-45b9-8818-0b8bf5a9e646 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:20.122050 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-c018bd71-9399-45b9-8818-0b8bf5a9e646 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] [instance: 0762660d-ef9c-4c5d-9f82-6d679b066641] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:20.130572 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c018bd71-9399-45b9-8818-0b8bf5a9e646 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:20.131066 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c018bd71-9399-45b9-8818-0b8bf5a9e646 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:20.131503 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c018bd71-9399-45b9-8818-0b8bf5a9e646 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:20.132238 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c018bd71-9399-45b9-8818-0b8bf5a9e646 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:20.132697 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c018bd71-9399-45b9-8818-0b8bf5a9e646 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:20.133147 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c018bd71-9399-45b9-8818-0b8bf5a9e646 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:20.232854 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-f73baa9b-f803-4a7f-9dc5-4f848c003e9b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:20.233445 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-f73baa9b-f803-4a7f-9dc5-4f848c003e9b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:20.240628 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f73baa9b-f803-4a7f-9dc5-4f848c003e9b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:20.241471 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f73baa9b-f803-4a7f-9dc5-4f848c003e9b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:20.241982 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f73baa9b-f803-4a7f-9dc5-4f848c003e9b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:20.242763 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f73baa9b-f803-4a7f-9dc5-4f848c003e9b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:20.243248 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f73baa9b-f803-4a7f-9dc5-4f848c003e9b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:20.243676 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f73baa9b-f803-4a7f-9dc5-4f848c003e9b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:20.413498 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-c018bd71-9399-45b9-8818-0b8bf5a9e646 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c727b8f265774a4bb03d8425212e7540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83857835f34141f18a89c759631878f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:20.422209 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-c018bd71-9399-45b9-8818-0b8bf5a9e646 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] 10.222.0.48 "GET /compute/v2.1/servers/0762660d-ef9c-4c5d-9f82-6d679b066641" status: 200 len: 1314 microversion: 2.1 time: 0.318408 Aug 11 11:06:20.422953 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 167/336] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:20 2022] GET /compute/v2.1/servers/0762660d-ef9c-4c5d-9f82-6d679b066641 => generated 1314 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:20.427681 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-bfbc6c1b-7ffa-49a5-ac2e-c20960ad27d7 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:20.428797 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-bfbc6c1b-7ffa-49a5-ac2e-c20960ad27d7 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] [instance: 3794302e-1657-4edd-9e15-a78592597d5b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:20.434597 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-bfbc6c1b-7ffa-49a5-ac2e-c20960ad27d7 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:20.435075 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-bfbc6c1b-7ffa-49a5-ac2e-c20960ad27d7 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:20.435639 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-bfbc6c1b-7ffa-49a5-ac2e-c20960ad27d7 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:20.436363 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-bfbc6c1b-7ffa-49a5-ac2e-c20960ad27d7 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:20.436809 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-bfbc6c1b-7ffa-49a5-ac2e-c20960ad27d7 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:20.437228 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-bfbc6c1b-7ffa-49a5-ac2e-c20960ad27d7 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:20.526916 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-bfbc6c1b-7ffa-49a5-ac2e-c20960ad27d7 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfaf5a716c5b448f8e1274de2fad307c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233f1c55781b4099be6e250e664c4fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:20.535003 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-bfbc6c1b-7ffa-49a5-ac2e-c20960ad27d7 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] 10.222.0.48 "GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b" status: 200 len: 1316 microversion: 2.1 time: 0.110999 Aug 11 11:06:20.535574 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 168/337] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:20 2022] GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b => generated 1316 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:20.560673 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-f73baa9b-f803-4a7f-9dc5-4f848c003e9b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:20.568468 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-f73baa9b-f803-4a7f-9dc5-4f848c003e9b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:20.569995 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-f73baa9b-f803-4a7f-9dc5-4f848c003e9b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:20.571149 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-f73baa9b-f803-4a7f-9dc5-4f848c003e9b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1737 microversion: 2.20 time: 0.342384 Aug 11 11:06:20.571711 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 170/338] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:06:20 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1737 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:06:21.131047 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-b53dbfa2-c2a4-446c-b104-31343cf45476 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:21.132513 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-b53dbfa2-c2a4-446c-b104-31343cf45476 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:21.146961 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b53dbfa2-c2a4-446c-b104-31343cf45476 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:21.151528 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b53dbfa2-c2a4-446c-b104-31343cf45476 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:21.157144 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b53dbfa2-c2a4-446c-b104-31343cf45476 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:21.158275 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b53dbfa2-c2a4-446c-b104-31343cf45476 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:21.158918 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b53dbfa2-c2a4-446c-b104-31343cf45476 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:21.159532 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b53dbfa2-c2a4-446c-b104-31343cf45476 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:21.391947 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-b53dbfa2-c2a4-446c-b104-31343cf45476 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:21.405086 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-b53dbfa2-c2a4-446c-b104-31343cf45476 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1724 microversion: 2.1 time: 0.279715 Aug 11 11:06:21.416134 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 169/339] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:21 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1724 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:21.442796 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-d6e58ea1-c726-46e0-9038-8cff53d3a911 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:21.443856 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-d6e58ea1-c726-46e0-9038-8cff53d3a911 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] [instance: 0762660d-ef9c-4c5d-9f82-6d679b066641] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:21.450529 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d6e58ea1-c726-46e0-9038-8cff53d3a911 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:21.451069 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d6e58ea1-c726-46e0-9038-8cff53d3a911 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:21.451501 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d6e58ea1-c726-46e0-9038-8cff53d3a911 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:21.452213 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d6e58ea1-c726-46e0-9038-8cff53d3a911 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:21.452684 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d6e58ea1-c726-46e0-9038-8cff53d3a911 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:21.453823 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d6e58ea1-c726-46e0-9038-8cff53d3a911 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:21.559732 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-9003cc59-3b14-4fe2-82d5-0fd8e03d910d tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:21.560509 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-9003cc59-3b14-4fe2-82d5-0fd8e03d910d tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] [instance: 3794302e-1657-4edd-9e15-a78592597d5b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:21.579813 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9003cc59-3b14-4fe2-82d5-0fd8e03d910d tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:21.589872 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9003cc59-3b14-4fe2-82d5-0fd8e03d910d tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:21.589872 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9003cc59-3b14-4fe2-82d5-0fd8e03d910d tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:21.589872 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9003cc59-3b14-4fe2-82d5-0fd8e03d910d tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:21.590325 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9003cc59-3b14-4fe2-82d5-0fd8e03d910d tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:21.590785 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9003cc59-3b14-4fe2-82d5-0fd8e03d910d tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:21.725779 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d6e58ea1-c726-46e0-9038-8cff53d3a911 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c727b8f265774a4bb03d8425212e7540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83857835f34141f18a89c759631878f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:21.734902 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-d6e58ea1-c726-46e0-9038-8cff53d3a911 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] 10.222.0.48 "GET /compute/v2.1/servers/0762660d-ef9c-4c5d-9f82-6d679b066641" status: 200 len: 1314 microversion: 2.1 time: 0.295230 Aug 11 11:06:21.736230 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 171/340] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:21 2022] GET /compute/v2.1/servers/0762660d-ef9c-4c5d-9f82-6d679b066641 => generated 1314 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:21.741754 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-6c95abe5-b2df-42cf-9310-4beb472b57b2 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:21.742521 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-6c95abe5-b2df-42cf-9310-4beb472b57b2 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:21.750553 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6c95abe5-b2df-42cf-9310-4beb472b57b2 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:21.751628 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6c95abe5-b2df-42cf-9310-4beb472b57b2 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:21.752299 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6c95abe5-b2df-42cf-9310-4beb472b57b2 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:21.756602 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6c95abe5-b2df-42cf-9310-4beb472b57b2 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:21.758055 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6c95abe5-b2df-42cf-9310-4beb472b57b2 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:21.758757 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6c95abe5-b2df-42cf-9310-4beb472b57b2 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:21.806402 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-9003cc59-3b14-4fe2-82d5-0fd8e03d910d tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfaf5a716c5b448f8e1274de2fad307c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233f1c55781b4099be6e250e664c4fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:21.821360 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-9003cc59-3b14-4fe2-82d5-0fd8e03d910d tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] 10.222.0.48 "GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b" status: 200 len: 1358 microversion: 2.1 time: 0.267397 Aug 11 11:06:21.821951 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 170/341] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:21 2022] GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b => generated 1358 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:21.950458 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-6c95abe5-b2df-42cf-9310-4beb472b57b2 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:21.961271 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-6c95abe5-b2df-42cf-9310-4beb472b57b2 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:21.962986 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-6c95abe5-b2df-42cf-9310-4beb472b57b2 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:21.964186 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-6c95abe5-b2df-42cf-9310-4beb472b57b2 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1737 microversion: 2.20 time: 0.226855 Aug 11 11:06:21.980903 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 172/342] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:06:21 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1737 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:06:22.435597 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-fa12b3a0-7c12-452b-add1-250f094d6a36 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:22.436719 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-fa12b3a0-7c12-452b-add1-250f094d6a36 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:22.444285 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fa12b3a0-7c12-452b-add1-250f094d6a36 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:22.445160 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fa12b3a0-7c12-452b-add1-250f094d6a36 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:22.445603 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fa12b3a0-7c12-452b-add1-250f094d6a36 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:22.446315 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fa12b3a0-7c12-452b-add1-250f094d6a36 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:22.446987 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fa12b3a0-7c12-452b-add1-250f094d6a36 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:22.447481 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fa12b3a0-7c12-452b-add1-250f094d6a36 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:22.652511 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-fa12b3a0-7c12-452b-add1-250f094d6a36 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:22.661939 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-fa12b3a0-7c12-452b-add1-250f094d6a36 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1724 microversion: 2.1 time: 0.234363 Aug 11 11:06:22.662510 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 171/343] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:22 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1724 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:06:22.766360 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-9a00c028-1195-4c6c-aff7-37346b157715 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:22.766996 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-9a00c028-1195-4c6c-aff7-37346b157715 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] [instance: 0762660d-ef9c-4c5d-9f82-6d679b066641] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:22.773616 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9a00c028-1195-4c6c-aff7-37346b157715 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:22.774173 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9a00c028-1195-4c6c-aff7-37346b157715 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:22.774670 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9a00c028-1195-4c6c-aff7-37346b157715 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:22.775465 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9a00c028-1195-4c6c-aff7-37346b157715 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:22.776071 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9a00c028-1195-4c6c-aff7-37346b157715 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:22.776560 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9a00c028-1195-4c6c-aff7-37346b157715 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:22.851944 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-21298f20-ea01-4cb4-b4b0-7d14499dbc19 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:22.855238 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-21298f20-ea01-4cb4-b4b0-7d14499dbc19 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] [instance: 3794302e-1657-4edd-9e15-a78592597d5b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:22.877552 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-21298f20-ea01-4cb4-b4b0-7d14499dbc19 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:22.878048 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-21298f20-ea01-4cb4-b4b0-7d14499dbc19 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:22.878483 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-21298f20-ea01-4cb4-b4b0-7d14499dbc19 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:22.879185 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-21298f20-ea01-4cb4-b4b0-7d14499dbc19 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:22.879638 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-21298f20-ea01-4cb4-b4b0-7d14499dbc19 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:22.891905 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-21298f20-ea01-4cb4-b4b0-7d14499dbc19 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:23.069981 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-9a00c028-1195-4c6c-aff7-37346b157715 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c727b8f265774a4bb03d8425212e7540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83857835f34141f18a89c759631878f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:23.081320 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-9a00c028-1195-4c6c-aff7-37346b157715 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] 10.222.0.48 "GET /compute/v2.1/servers/0762660d-ef9c-4c5d-9f82-6d679b066641" status: 200 len: 1314 microversion: 2.1 time: 0.321028 Aug 11 11:06:23.082808 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 173/344] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:22 2022] GET /compute/v2.1/servers/0762660d-ef9c-4c5d-9f82-6d679b066641 => generated 1314 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:23.092353 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-fc70fe54-571b-4e7e-9aeb-61a8000bae93 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:23.092956 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-fc70fe54-571b-4e7e-9aeb-61a8000bae93 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:23.104020 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fc70fe54-571b-4e7e-9aeb-61a8000bae93 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:23.104745 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fc70fe54-571b-4e7e-9aeb-61a8000bae93 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:23.105334 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fc70fe54-571b-4e7e-9aeb-61a8000bae93 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:23.106327 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fc70fe54-571b-4e7e-9aeb-61a8000bae93 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:23.106923 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fc70fe54-571b-4e7e-9aeb-61a8000bae93 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:23.107481 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fc70fe54-571b-4e7e-9aeb-61a8000bae93 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:23.185890 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-21298f20-ea01-4cb4-b4b0-7d14499dbc19 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfaf5a716c5b448f8e1274de2fad307c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233f1c55781b4099be6e250e664c4fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:23.194024 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-21298f20-ea01-4cb4-b4b0-7d14499dbc19 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] 10.222.0.48 "GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b" status: 200 len: 1358 microversion: 2.1 time: 0.351283 Aug 11 11:06:23.194829 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 172/345] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:22 2022] GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b => generated 1358 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:23.352401 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-fc70fe54-571b-4e7e-9aeb-61a8000bae93 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:23.360451 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-fc70fe54-571b-4e7e-9aeb-61a8000bae93 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:23.361997 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-fc70fe54-571b-4e7e-9aeb-61a8000bae93 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:23.363154 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-fc70fe54-571b-4e7e-9aeb-61a8000bae93 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1737 microversion: 2.20 time: 0.278626 Aug 11 11:06:23.376158 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 174/346] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:06:23 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1737 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:06:23.684312 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-45758275-1f12-4ac0-8cae-fc8a6800e21a tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:23.685509 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-45758275-1f12-4ac0-8cae-fc8a6800e21a tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:23.692557 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-45758275-1f12-4ac0-8cae-fc8a6800e21a tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:23.693051 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-45758275-1f12-4ac0-8cae-fc8a6800e21a tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:23.693483 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-45758275-1f12-4ac0-8cae-fc8a6800e21a tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:23.694396 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-45758275-1f12-4ac0-8cae-fc8a6800e21a tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:23.694855 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-45758275-1f12-4ac0-8cae-fc8a6800e21a tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:23.695284 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-45758275-1f12-4ac0-8cae-fc8a6800e21a tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:24.022729 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-45758275-1f12-4ac0-8cae-fc8a6800e21a tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:24.038327 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-45758275-1f12-4ac0-8cae-fc8a6800e21a tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1724 microversion: 2.1 time: 0.353869 Aug 11 11:06:24.060140 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 173/347] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:23 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1724 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:24.113414 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-d1f68329-a206-4b96-9425-c1df9a330753 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:24.116148 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-d1f68329-a206-4b96-9425-c1df9a330753 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] [instance: 0762660d-ef9c-4c5d-9f82-6d679b066641] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:24.130359 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d1f68329-a206-4b96-9425-c1df9a330753 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:24.130880 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d1f68329-a206-4b96-9425-c1df9a330753 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:24.131580 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d1f68329-a206-4b96-9425-c1df9a330753 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:24.132336 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d1f68329-a206-4b96-9425-c1df9a330753 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:24.132783 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d1f68329-a206-4b96-9425-c1df9a330753 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:24.133458 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d1f68329-a206-4b96-9425-c1df9a330753 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:24.223327 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-d2a9cbcf-ba5e-402c-8816-101dd245b146 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:24.223994 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-d2a9cbcf-ba5e-402c-8816-101dd245b146 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] [instance: 3794302e-1657-4edd-9e15-a78592597d5b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:24.231605 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d2a9cbcf-ba5e-402c-8816-101dd245b146 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:24.232126 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d2a9cbcf-ba5e-402c-8816-101dd245b146 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:24.232744 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d2a9cbcf-ba5e-402c-8816-101dd245b146 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:24.233845 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d2a9cbcf-ba5e-402c-8816-101dd245b146 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:24.235268 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d2a9cbcf-ba5e-402c-8816-101dd245b146 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:24.235926 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d2a9cbcf-ba5e-402c-8816-101dd245b146 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:24.263986 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell0:SELECT=4 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:24.594252 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d1f68329-a206-4b96-9425-c1df9a330753 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c727b8f265774a4bb03d8425212e7540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83857835f34141f18a89c759631878f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:24.605034 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-d1f68329-a206-4b96-9425-c1df9a330753 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] 10.222.0.48 "GET /compute/v2.1/servers/0762660d-ef9c-4c5d-9f82-6d679b066641" status: 200 len: 1314 microversion: 2.1 time: 0.501070 Aug 11 11:06:24.605685 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 175/348] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:24 2022] GET /compute/v2.1/servers/0762660d-ef9c-4c5d-9f82-6d679b066641 => generated 1314 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:24.611737 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-de78e3d2-d21e-4ff7-b0b2-16085662d391 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:24.613863 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-de78e3d2-d21e-4ff7-b0b2-16085662d391 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:24.621976 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-de78e3d2-d21e-4ff7-b0b2-16085662d391 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:24.622732 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-de78e3d2-d21e-4ff7-b0b2-16085662d391 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:24.623823 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-de78e3d2-d21e-4ff7-b0b2-16085662d391 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:24.624978 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-de78e3d2-d21e-4ff7-b0b2-16085662d391 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:24.625555 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-de78e3d2-d21e-4ff7-b0b2-16085662d391 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:24.626084 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-de78e3d2-d21e-4ff7-b0b2-16085662d391 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:24.627084 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-d2a9cbcf-ba5e-402c-8816-101dd245b146 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfaf5a716c5b448f8e1274de2fad307c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233f1c55781b4099be6e250e664c4fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:24.638683 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-d2a9cbcf-ba5e-402c-8816-101dd245b146 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] 10.222.0.48 "GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b" status: 200 len: 1358 microversion: 2.1 time: 0.420218 Aug 11 11:06:24.652234 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 174/349] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:24 2022] GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b => generated 1358 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:06:24.748547 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-fc5b27a0-5168-4a65-be12-77c77ef5f095 req-18e3e1d2-574d-4caa-b55f-452b1a2b5185 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3794302e-1657-4edd-9e15-a78592597d5b", "tag": "8d6a01cf-8904-414f-b58d-2be53d6e73d1"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:06:24.766071 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-fc5b27a0-5168-4a65-be12-77c77ef5f095 req-18e3e1d2-574d-4caa-b55f-452b1a2b5185 service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:24.766557 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-fc5b27a0-5168-4a65-be12-77c77ef5f095 req-18e3e1d2-574d-4caa-b55f-452b1a2b5185 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:24.768825 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-fc5b27a0-5168-4a65-be12-77c77ef5f095 req-18e3e1d2-574d-4caa-b55f-452b1a2b5185 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:24.798788 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-fc5b27a0-5168-4a65-be12-77c77ef5f095 req-18e3e1d2-574d-4caa-b55f-452b1a2b5185 service nova] Creating event network-changed:8d6a01cf-8904-414f-b58d-2be53d6e73d1 for instance 3794302e-1657-4edd-9e15-a78592597d5b on hv-cinder-82002 Aug 11 11:06:24.800097 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-fc5b27a0-5168-4a65-be12-77c77ef5f095 req-18e3e1d2-574d-4caa-b55f-452b1a2b5185 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055498 Aug 11 11:06:24.801167 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 175/350] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:06:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 11:06:24.851113 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-de78e3d2-d21e-4ff7-b0b2-16085662d391 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:24.872128 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-de78e3d2-d21e-4ff7-b0b2-16085662d391 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:24.873828 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-de78e3d2-d21e-4ff7-b0b2-16085662d391 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:24.876439 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-de78e3d2-d21e-4ff7-b0b2-16085662d391 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1737 microversion: 2.20 time: 0.269442 Aug 11 11:06:24.877354 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 176/351] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:06:24 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1737 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:06:25.061050 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell0:SELECT=18 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:25.068014 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-7a6f2431-5edd-4a75-b6b5-3183a1b31fba tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:25.069235 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-7a6f2431-5edd-4a75-b6b5-3183a1b31fba tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:25.080030 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7a6f2431-5edd-4a75-b6b5-3183a1b31fba tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:25.080030 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7a6f2431-5edd-4a75-b6b5-3183a1b31fba tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:25.080770 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7a6f2431-5edd-4a75-b6b5-3183a1b31fba tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:25.082192 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7a6f2431-5edd-4a75-b6b5-3183a1b31fba tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:25.083428 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7a6f2431-5edd-4a75-b6b5-3183a1b31fba tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:25.084127 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7a6f2431-5edd-4a75-b6b5-3183a1b31fba tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:25.414802 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-7a6f2431-5edd-4a75-b6b5-3183a1b31fba tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:25.445396 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-7a6f2431-5edd-4a75-b6b5-3183a1b31fba tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1724 microversion: 2.1 time: 0.385450 Aug 11 11:06:25.463063 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 176/352] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:25 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1724 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:25.625487 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-fe52d744-0f81-4060-9e80-1246e7999fe6 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:25.631521 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-fe52d744-0f81-4060-9e80-1246e7999fe6 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] [instance: 0762660d-ef9c-4c5d-9f82-6d679b066641] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:25.644699 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fe52d744-0f81-4060-9e80-1246e7999fe6 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:25.645184 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fe52d744-0f81-4060-9e80-1246e7999fe6 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:25.645791 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fe52d744-0f81-4060-9e80-1246e7999fe6 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:25.646642 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fe52d744-0f81-4060-9e80-1246e7999fe6 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:25.647291 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fe52d744-0f81-4060-9e80-1246e7999fe6 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:25.648293 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fe52d744-0f81-4060-9e80-1246e7999fe6 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:25.663425 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-339b4211-7bea-43bd-bd73-cd6c48f04bc5 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:25.664742 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-339b4211-7bea-43bd-bd73-cd6c48f04bc5 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] [instance: 3794302e-1657-4edd-9e15-a78592597d5b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:25.678438 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-339b4211-7bea-43bd-bd73-cd6c48f04bc5 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:25.680327 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-339b4211-7bea-43bd-bd73-cd6c48f04bc5 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:25.682260 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-339b4211-7bea-43bd-bd73-cd6c48f04bc5 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:25.683221 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-339b4211-7bea-43bd-bd73-cd6c48f04bc5 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:25.686205 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-339b4211-7bea-43bd-bd73-cd6c48f04bc5 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:25.687383 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-339b4211-7bea-43bd-bd73-cd6c48f04bc5 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:25.888940 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-fe52d744-0f81-4060-9e80-1246e7999fe6 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c727b8f265774a4bb03d8425212e7540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83857835f34141f18a89c759631878f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:25.893063 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-339b4211-7bea-43bd-bd73-cd6c48f04bc5 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfaf5a716c5b448f8e1274de2fad307c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233f1c55781b4099be6e250e664c4fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:25.896881 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-fe52d744-0f81-4060-9e80-1246e7999fe6 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] 10.222.0.48 "GET /compute/v2.1/servers/0762660d-ef9c-4c5d-9f82-6d679b066641" status: 200 len: 1314 microversion: 2.1 time: 0.275164 Aug 11 11:06:25.897454 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 177/353] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:25 2022] GET /compute/v2.1/servers/0762660d-ef9c-4c5d-9f82-6d679b066641 => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:25.902011 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-8694b556-2035-4fe0-a3b5-0e07e7eed2ac tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:25.903617 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-8694b556-2035-4fe0-a3b5-0e07e7eed2ac tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:25.904404 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-339b4211-7bea-43bd-bd73-cd6c48f04bc5 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] 10.222.0.48 "GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b" status: 200 len: 1358 microversion: 2.1 time: 0.246989 Aug 11 11:06:25.906038 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 177/354] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:25 2022] GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b => generated 1358 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:06:25.919737 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8694b556-2035-4fe0-a3b5-0e07e7eed2ac tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:25.919737 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8694b556-2035-4fe0-a3b5-0e07e7eed2ac tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:25.919737 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8694b556-2035-4fe0-a3b5-0e07e7eed2ac tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:25.919737 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8694b556-2035-4fe0-a3b5-0e07e7eed2ac tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:25.920282 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8694b556-2035-4fe0-a3b5-0e07e7eed2ac tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:25.920282 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8694b556-2035-4fe0-a3b5-0e07e7eed2ac tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:26.066612 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-8694b556-2035-4fe0-a3b5-0e07e7eed2ac tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:26.074481 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-8694b556-2035-4fe0-a3b5-0e07e7eed2ac tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:26.076005 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-8694b556-2035-4fe0-a3b5-0e07e7eed2ac tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:26.077164 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-8694b556-2035-4fe0-a3b5-0e07e7eed2ac tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1737 microversion: 2.20 time: 0.178778 Aug 11 11:06:26.078234 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 178/355] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:06:25 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1737 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:06:26.477076 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-536df23d-a02a-4de8-b320-230007779c50 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:26.477076 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-536df23d-a02a-4de8-b320-230007779c50 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:26.488179 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-536df23d-a02a-4de8-b320-230007779c50 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:26.489367 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-536df23d-a02a-4de8-b320-230007779c50 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:26.489961 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-536df23d-a02a-4de8-b320-230007779c50 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:26.496394 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-536df23d-a02a-4de8-b320-230007779c50 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:26.497085 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-536df23d-a02a-4de8-b320-230007779c50 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:26.497759 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-536df23d-a02a-4de8-b320-230007779c50 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:26.676083 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-536df23d-a02a-4de8-b320-230007779c50 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:26.685015 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-536df23d-a02a-4de8-b320-230007779c50 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1724 microversion: 2.1 time: 0.215924 Aug 11 11:06:26.699864 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 178/356] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:26 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1724 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:26.918450 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-45cce4a7-c31d-4843-b483-3a8d789e7e63 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:26.919071 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-45cce4a7-c31d-4843-b483-3a8d789e7e63 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] [instance: 0762660d-ef9c-4c5d-9f82-6d679b066641] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:26.926764 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-59c535ba-0dd5-4fe3-a174-8498896c5c8b tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:26.928786 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-59c535ba-0dd5-4fe3-a174-8498896c5c8b tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] [instance: 3794302e-1657-4edd-9e15-a78592597d5b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:26.933899 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-45cce4a7-c31d-4843-b483-3a8d789e7e63 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:26.935319 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-45cce4a7-c31d-4843-b483-3a8d789e7e63 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:26.935319 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-45cce4a7-c31d-4843-b483-3a8d789e7e63 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:26.935610 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-45cce4a7-c31d-4843-b483-3a8d789e7e63 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:26.936268 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-45cce4a7-c31d-4843-b483-3a8d789e7e63 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:26.936869 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-45cce4a7-c31d-4843-b483-3a8d789e7e63 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:26.943390 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-59c535ba-0dd5-4fe3-a174-8498896c5c8b tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:26.943988 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-59c535ba-0dd5-4fe3-a174-8498896c5c8b tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:26.944547 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-59c535ba-0dd5-4fe3-a174-8498896c5c8b tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:26.945380 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-59c535ba-0dd5-4fe3-a174-8498896c5c8b tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:26.946057 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-59c535ba-0dd5-4fe3-a174-8498896c5c8b tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:26.946567 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-59c535ba-0dd5-4fe3-a174-8498896c5c8b tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:27.043102 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell0:SELECT=8 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:27.144776 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-45cce4a7-c31d-4843-b483-3a8d789e7e63 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c727b8f265774a4bb03d8425212e7540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83857835f34141f18a89c759631878f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:27.156157 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-45cce4a7-c31d-4843-b483-3a8d789e7e63 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] 10.222.0.48 "GET /compute/v2.1/servers/0762660d-ef9c-4c5d-9f82-6d679b066641" status: 200 len: 1314 microversion: 2.1 time: 0.240794 Aug 11 11:06:27.156960 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 179/357] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:26 2022] GET /compute/v2.1/servers/0762660d-ef9c-4c5d-9f82-6d679b066641 => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:27.158209 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-59c535ba-0dd5-4fe3-a174-8498896c5c8b tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfaf5a716c5b448f8e1274de2fad307c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233f1c55781b4099be6e250e664c4fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:27.161948 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-5ed16fd7-c824-4223-9bb4-5960700d8651 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:27.162200 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-5ed16fd7-c824-4223-9bb4-5960700d8651 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:27.167182 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-59c535ba-0dd5-4fe3-a174-8498896c5c8b tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] 10.222.0.48 "GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b" status: 200 len: 1358 microversion: 2.1 time: 0.244672 Aug 11 11:06:27.168034 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 179/358] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:26 2022] GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b => generated 1358 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:27.168179 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5ed16fd7-c824-4223-9bb4-5960700d8651 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:27.168576 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5ed16fd7-c824-4223-9bb4-5960700d8651 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:27.168999 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5ed16fd7-c824-4223-9bb4-5960700d8651 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:27.169683 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5ed16fd7-c824-4223-9bb4-5960700d8651 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:27.170129 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5ed16fd7-c824-4223-9bb4-5960700d8651 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:27.170544 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5ed16fd7-c824-4223-9bb4-5960700d8651 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:27.309636 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-5ed16fd7-c824-4223-9bb4-5960700d8651 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:27.318771 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-5ed16fd7-c824-4223-9bb4-5960700d8651 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:27.320298 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-5ed16fd7-c824-4223-9bb4-5960700d8651 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:27.329383 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-5ed16fd7-c824-4223-9bb4-5960700d8651 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1737 microversion: 2.20 time: 0.171493 Aug 11 11:06:27.330276 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 180/359] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:06:27 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1737 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:06:27.706465 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-ad249813-8728-4627-82ef-2e268ee9c97f tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:27.707074 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-ad249813-8728-4627-82ef-2e268ee9c97f tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:27.713157 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ad249813-8728-4627-82ef-2e268ee9c97f tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:27.713654 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ad249813-8728-4627-82ef-2e268ee9c97f tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:27.714093 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ad249813-8728-4627-82ef-2e268ee9c97f tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:27.714800 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ad249813-8728-4627-82ef-2e268ee9c97f tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:27.715253 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ad249813-8728-4627-82ef-2e268ee9c97f tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:27.715684 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ad249813-8728-4627-82ef-2e268ee9c97f tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:27.851707 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-ad249813-8728-4627-82ef-2e268ee9c97f tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:27.860912 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-ad249813-8728-4627-82ef-2e268ee9c97f tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1724 microversion: 2.1 time: 0.158166 Aug 11 11:06:27.861587 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 180/360] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:27 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:28.177100 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-4e176037-3e0d-4725-ba57-f5d8c0d3e4c6 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:28.177671 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-4e176037-3e0d-4725-ba57-f5d8c0d3e4c6 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] [instance: 0762660d-ef9c-4c5d-9f82-6d679b066641] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:28.185843 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4e176037-3e0d-4725-ba57-f5d8c0d3e4c6 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:28.186327 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4e176037-3e0d-4725-ba57-f5d8c0d3e4c6 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:28.196189 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-1c440e76-acae-46e9-b4f3-594cbc50ecf4 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:28.197499 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4e176037-3e0d-4725-ba57-f5d8c0d3e4c6 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:28.198384 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4e176037-3e0d-4725-ba57-f5d8c0d3e4c6 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:28.198870 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4e176037-3e0d-4725-ba57-f5d8c0d3e4c6 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:28.199298 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4e176037-3e0d-4725-ba57-f5d8c0d3e4c6 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:28.199666 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-1c440e76-acae-46e9-b4f3-594cbc50ecf4 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] [instance: 3794302e-1657-4edd-9e15-a78592597d5b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:28.209390 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1c440e76-acae-46e9-b4f3-594cbc50ecf4 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:28.210203 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1c440e76-acae-46e9-b4f3-594cbc50ecf4 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:28.210736 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1c440e76-acae-46e9-b4f3-594cbc50ecf4 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:28.215400 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1c440e76-acae-46e9-b4f3-594cbc50ecf4 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:28.215400 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1c440e76-acae-46e9-b4f3-594cbc50ecf4 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:28.215400 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1c440e76-acae-46e9-b4f3-594cbc50ecf4 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:28.423250 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-1c440e76-acae-46e9-b4f3-594cbc50ecf4 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfaf5a716c5b448f8e1274de2fad307c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233f1c55781b4099be6e250e664c4fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:28.431317 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-4e176037-3e0d-4725-ba57-f5d8c0d3e4c6 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c727b8f265774a4bb03d8425212e7540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83857835f34141f18a89c759631878f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:28.431601 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-1c440e76-acae-46e9-b4f3-594cbc50ecf4 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] 10.222.0.48 "GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b" status: 200 len: 1358 microversion: 2.1 time: 0.240230 Aug 11 11:06:28.443793 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 181/361] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:28 2022] GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b => generated 1358 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:28.444702 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-4e176037-3e0d-4725-ba57-f5d8c0d3e4c6 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] 10.222.0.48 "GET /compute/v2.1/servers/0762660d-ef9c-4c5d-9f82-6d679b066641" status: 200 len: 1314 microversion: 2.1 time: 0.272049 Aug 11 11:06:28.445469 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 181/362] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:28 2022] GET /compute/v2.1/servers/0762660d-ef9c-4c5d-9f82-6d679b066641 => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:28.448673 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-f87f7ebe-b44f-4205-98df-69fb8e6ee8c4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:28.451098 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-f87f7ebe-b44f-4205-98df-69fb8e6ee8c4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:28.463153 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f87f7ebe-b44f-4205-98df-69fb8e6ee8c4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:28.463648 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f87f7ebe-b44f-4205-98df-69fb8e6ee8c4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:28.464113 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f87f7ebe-b44f-4205-98df-69fb8e6ee8c4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:28.464853 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f87f7ebe-b44f-4205-98df-69fb8e6ee8c4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:28.465308 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f87f7ebe-b44f-4205-98df-69fb8e6ee8c4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:28.465739 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f87f7ebe-b44f-4205-98df-69fb8e6ee8c4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:28.473350 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell1:SELECT=100 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:28.615455 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-f87f7ebe-b44f-4205-98df-69fb8e6ee8c4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:28.625061 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-f87f7ebe-b44f-4205-98df-69fb8e6ee8c4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:28.626577 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-f87f7ebe-b44f-4205-98df-69fb8e6ee8c4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:28.627752 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-f87f7ebe-b44f-4205-98df-69fb8e6ee8c4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1737 microversion: 2.20 time: 0.194333 Aug 11 11:06:28.628339 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 182/363] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:06:28 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1737 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:06:28.882157 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-343ef34e-d17e-43cc-beab-b463d6873982 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:28.882894 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-343ef34e-d17e-43cc-beab-b463d6873982 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:28.894810 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-343ef34e-d17e-43cc-beab-b463d6873982 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:28.896160 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-343ef34e-d17e-43cc-beab-b463d6873982 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:28.896160 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-343ef34e-d17e-43cc-beab-b463d6873982 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:28.896841 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-343ef34e-d17e-43cc-beab-b463d6873982 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:28.897431 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-343ef34e-d17e-43cc-beab-b463d6873982 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:28.897984 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-343ef34e-d17e-43cc-beab-b463d6873982 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:29.090178 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-343ef34e-d17e-43cc-beab-b463d6873982 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:29.099211 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-343ef34e-d17e-43cc-beab-b463d6873982 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1724 microversion: 2.1 time: 0.221147 Aug 11 11:06:29.099831 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 182/364] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:28 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1724 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:29.459358 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-1bae325d-7310-4dba-b046-ba81e60f471b tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:29.459979 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-1bae325d-7310-4dba-b046-ba81e60f471b tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] [instance: 3794302e-1657-4edd-9e15-a78592597d5b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:29.464352 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-0151f8ff-ccb3-4fa9-83c5-7a562228386c tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:29.465072 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-0151f8ff-ccb3-4fa9-83c5-7a562228386c tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] [instance: 0762660d-ef9c-4c5d-9f82-6d679b066641] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:29.466792 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1bae325d-7310-4dba-b046-ba81e60f471b tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:29.467381 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1bae325d-7310-4dba-b046-ba81e60f471b tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:29.467852 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1bae325d-7310-4dba-b046-ba81e60f471b tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:29.469698 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1bae325d-7310-4dba-b046-ba81e60f471b tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:29.469698 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1bae325d-7310-4dba-b046-ba81e60f471b tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:29.469698 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1bae325d-7310-4dba-b046-ba81e60f471b tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:29.472528 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0151f8ff-ccb3-4fa9-83c5-7a562228386c tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:29.473157 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0151f8ff-ccb3-4fa9-83c5-7a562228386c tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:29.473646 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0151f8ff-ccb3-4fa9-83c5-7a562228386c tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:29.474455 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0151f8ff-ccb3-4fa9-83c5-7a562228386c tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:29.475009 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0151f8ff-ccb3-4fa9-83c5-7a562228386c tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:29.475434 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0151f8ff-ccb3-4fa9-83c5-7a562228386c tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:29.734838 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-0151f8ff-ccb3-4fa9-83c5-7a562228386c tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c727b8f265774a4bb03d8425212e7540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83857835f34141f18a89c759631878f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:29.738401 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-1bae325d-7310-4dba-b046-ba81e60f471b tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfaf5a716c5b448f8e1274de2fad307c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233f1c55781b4099be6e250e664c4fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:29.745893 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-0151f8ff-ccb3-4fa9-83c5-7a562228386c tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] 10.222.0.48 "GET /compute/v2.1/servers/0762660d-ef9c-4c5d-9f82-6d679b066641" status: 200 len: 1314 microversion: 2.1 time: 0.284859 Aug 11 11:06:29.750732 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-1bae325d-7310-4dba-b046-ba81e60f471b tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] 10.222.0.48 "GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b" status: 200 len: 1358 microversion: 2.1 time: 0.295116 Aug 11 11:06:29.760879 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 183/365] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:29 2022] GET /compute/v2.1/servers/0762660d-ef9c-4c5d-9f82-6d679b066641 => generated 1314 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:06:29.764063 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 183/366] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:29 2022] GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b => generated 1358 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:29.768828 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-31f94c1c-ad18-4ac1-a207-c42eb3b16a9f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:29.769388 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-31f94c1c-ad18-4ac1-a207-c42eb3b16a9f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:29.784991 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-31f94c1c-ad18-4ac1-a207-c42eb3b16a9f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:29.785483 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-31f94c1c-ad18-4ac1-a207-c42eb3b16a9f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:29.789719 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-31f94c1c-ad18-4ac1-a207-c42eb3b16a9f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:29.792934 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-31f94c1c-ad18-4ac1-a207-c42eb3b16a9f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:29.792934 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-31f94c1c-ad18-4ac1-a207-c42eb3b16a9f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:29.792934 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-31f94c1c-ad18-4ac1-a207-c42eb3b16a9f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:29.971055 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-31f94c1c-ad18-4ac1-a207-c42eb3b16a9f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:29.979698 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-31f94c1c-ad18-4ac1-a207-c42eb3b16a9f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:29.981265 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-31f94c1c-ad18-4ac1-a207-c42eb3b16a9f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:29.982438 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-31f94c1c-ad18-4ac1-a207-c42eb3b16a9f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1737 microversion: 2.20 time: 0.220208 Aug 11 11:06:29.983020 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 184/367] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:06:29 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1737 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:06:30.120663 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-156a668c-d569-4fe5-ad34-58a32ae00c24 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:30.121235 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-156a668c-d569-4fe5-ad34-58a32ae00c24 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:30.128217 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-156a668c-d569-4fe5-ad34-58a32ae00c24 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:30.128736 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-156a668c-d569-4fe5-ad34-58a32ae00c24 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:30.129206 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-156a668c-d569-4fe5-ad34-58a32ae00c24 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:30.129916 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-156a668c-d569-4fe5-ad34-58a32ae00c24 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:30.130372 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-156a668c-d569-4fe5-ad34-58a32ae00c24 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:30.130800 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-156a668c-d569-4fe5-ad34-58a32ae00c24 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:30.299718 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-156a668c-d569-4fe5-ad34-58a32ae00c24 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:30.315659 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-156a668c-d569-4fe5-ad34-58a32ae00c24 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1724 microversion: 2.1 time: 0.198221 Aug 11 11:06:30.316157 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 184/368] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:30 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1724 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:30.773145 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-899cced4-e377-4f7a-8838-d9a6a77317e2 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:30.773744 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-899cced4-e377-4f7a-8838-d9a6a77317e2 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] [instance: 0762660d-ef9c-4c5d-9f82-6d679b066641] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:30.774536 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-7c401528-441a-4baf-ba10-77bddd226008 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:30.775232 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-7c401528-441a-4baf-ba10-77bddd226008 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] [instance: 3794302e-1657-4edd-9e15-a78592597d5b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:30.781350 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-899cced4-e377-4f7a-8838-d9a6a77317e2 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:30.781649 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7c401528-441a-4baf-ba10-77bddd226008 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:30.781885 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-899cced4-e377-4f7a-8838-d9a6a77317e2 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:30.782131 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7c401528-441a-4baf-ba10-77bddd226008 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:30.782425 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-899cced4-e377-4f7a-8838-d9a6a77317e2 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:30.782544 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7c401528-441a-4baf-ba10-77bddd226008 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:30.783180 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-899cced4-e377-4f7a-8838-d9a6a77317e2 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:30.783278 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7c401528-441a-4baf-ba10-77bddd226008 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:30.783673 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7c401528-441a-4baf-ba10-77bddd226008 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:30.783802 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-899cced4-e377-4f7a-8838-d9a6a77317e2 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:30.784119 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7c401528-441a-4baf-ba10-77bddd226008 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:30.784217 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-899cced4-e377-4f7a-8838-d9a6a77317e2 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:31.003974 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-7c401528-441a-4baf-ba10-77bddd226008 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfaf5a716c5b448f8e1274de2fad307c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233f1c55781b4099be6e250e664c4fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:31.010027 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-899cced4-e377-4f7a-8838-d9a6a77317e2 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c727b8f265774a4bb03d8425212e7540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83857835f34141f18a89c759631878f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:31.011807 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-7c401528-441a-4baf-ba10-77bddd226008 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] 10.222.0.48 "GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b" status: 200 len: 1358 microversion: 2.1 time: 0.241112 Aug 11 11:06:31.012538 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 185/369] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:30 2022] GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b => generated 1358 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:06:31.017473 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-899cced4-e377-4f7a-8838-d9a6a77317e2 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] 10.222.0.48 "GET /compute/v2.1/servers/0762660d-ef9c-4c5d-9f82-6d679b066641" status: 200 len: 1314 microversion: 2.1 time: 0.248936 Aug 11 11:06:31.017640 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-e3069a56-4f20-4cc0-b3d0-2bc80226223d tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:31.018034 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 185/370] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:30 2022] GET /compute/v2.1/servers/0762660d-ef9c-4c5d-9f82-6d679b066641 => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:31.018402 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-e3069a56-4f20-4cc0-b3d0-2bc80226223d tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:31.025239 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e3069a56-4f20-4cc0-b3d0-2bc80226223d tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:31.026087 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e3069a56-4f20-4cc0-b3d0-2bc80226223d tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:31.026753 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e3069a56-4f20-4cc0-b3d0-2bc80226223d tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:31.027913 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e3069a56-4f20-4cc0-b3d0-2bc80226223d tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:31.028592 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e3069a56-4f20-4cc0-b3d0-2bc80226223d tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:31.029227 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e3069a56-4f20-4cc0-b3d0-2bc80226223d tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:31.197630 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-e3069a56-4f20-4cc0-b3d0-2bc80226223d tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:31.205970 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-e3069a56-4f20-4cc0-b3d0-2bc80226223d tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:31.207572 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-e3069a56-4f20-4cc0-b3d0-2bc80226223d tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:31.208866 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-e3069a56-4f20-4cc0-b3d0-2bc80226223d tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1737 microversion: 2.20 time: 0.195208 Aug 11 11:06:31.209509 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 186/371] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:06:31 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1737 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:06:31.335681 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-146333dc-d40b-46fa-8c92-85237a591cec tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:31.336314 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-146333dc-d40b-46fa-8c92-85237a591cec tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:31.342665 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-146333dc-d40b-46fa-8c92-85237a591cec tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:31.343221 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-146333dc-d40b-46fa-8c92-85237a591cec tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:31.343860 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-146333dc-d40b-46fa-8c92-85237a591cec tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:31.344735 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-146333dc-d40b-46fa-8c92-85237a591cec tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:31.345467 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-146333dc-d40b-46fa-8c92-85237a591cec tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:31.345918 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-146333dc-d40b-46fa-8c92-85237a591cec tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:31.371439 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=100 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:31.499590 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-146333dc-d40b-46fa-8c92-85237a591cec tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:31.510449 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-146333dc-d40b-46fa-8c92-85237a591cec tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1724 microversion: 2.1 time: 0.178594 Aug 11 11:06:31.511856 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 186/372] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:31 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:32.041905 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-26abed72-195e-469c-ad64-268b8a0b386d tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:32.043666 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-26abed72-195e-469c-ad64-268b8a0b386d tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] [instance: 0762660d-ef9c-4c5d-9f82-6d679b066641] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:32.051717 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-90f51bac-f5ce-4db4-89f8-100e1e180180 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:32.054203 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-90f51bac-f5ce-4db4-89f8-100e1e180180 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] [instance: 3794302e-1657-4edd-9e15-a78592597d5b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:32.055946 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-26abed72-195e-469c-ad64-268b8a0b386d tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:32.056844 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-26abed72-195e-469c-ad64-268b8a0b386d tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:32.057524 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-26abed72-195e-469c-ad64-268b8a0b386d tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:32.058342 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-26abed72-195e-469c-ad64-268b8a0b386d tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:32.058930 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-26abed72-195e-469c-ad64-268b8a0b386d tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:32.059462 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-26abed72-195e-469c-ad64-268b8a0b386d tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:32.061756 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-90f51bac-f5ce-4db4-89f8-100e1e180180 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:32.062263 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-90f51bac-f5ce-4db4-89f8-100e1e180180 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:32.062811 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-90f51bac-f5ce-4db4-89f8-100e1e180180 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:32.063501 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-90f51bac-f5ce-4db4-89f8-100e1e180180 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:32.064646 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-90f51bac-f5ce-4db4-89f8-100e1e180180 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:32.064646 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-90f51bac-f5ce-4db4-89f8-100e1e180180 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:32.271457 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-26abed72-195e-469c-ad64-268b8a0b386d tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c727b8f265774a4bb03d8425212e7540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83857835f34141f18a89c759631878f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:32.280302 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-26abed72-195e-469c-ad64-268b8a0b386d tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] 10.222.0.48 "GET /compute/v2.1/servers/0762660d-ef9c-4c5d-9f82-6d679b066641" status: 200 len: 1314 microversion: 2.1 time: 0.243700 Aug 11 11:06:32.283210 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 187/373] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:32 2022] GET /compute/v2.1/servers/0762660d-ef9c-4c5d-9f82-6d679b066641 => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:06:32.289932 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-6ef365ef-376b-483b-8886-9bbf63700c34 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:32.290539 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-6ef365ef-376b-483b-8886-9bbf63700c34 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:32.300797 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-90f51bac-f5ce-4db4-89f8-100e1e180180 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfaf5a716c5b448f8e1274de2fad307c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233f1c55781b4099be6e250e664c4fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:32.302454 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6ef365ef-376b-483b-8886-9bbf63700c34 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:32.303284 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6ef365ef-376b-483b-8886-9bbf63700c34 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:32.303928 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6ef365ef-376b-483b-8886-9bbf63700c34 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:32.304933 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6ef365ef-376b-483b-8886-9bbf63700c34 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:32.305601 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6ef365ef-376b-483b-8886-9bbf63700c34 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:32.306132 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6ef365ef-376b-483b-8886-9bbf63700c34 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:32.317989 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-90f51bac-f5ce-4db4-89f8-100e1e180180 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] 10.222.0.48 "GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b" status: 200 len: 1358 microversion: 2.1 time: 0.288919 Aug 11 11:06:32.319352 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 187/374] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:32 2022] GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b => generated 1358 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:32.484674 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-6ef365ef-376b-483b-8886-9bbf63700c34 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:32.493110 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-6ef365ef-376b-483b-8886-9bbf63700c34 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:32.494635 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-6ef365ef-376b-483b-8886-9bbf63700c34 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:32.495845 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-6ef365ef-376b-483b-8886-9bbf63700c34 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1737 microversion: 2.20 time: 0.210001 Aug 11 11:06:32.496391 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 188/375] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:06:32 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1737 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:06:32.534608 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-6a532cde-db69-4381-8ea6-1bd7f983aa80 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:32.538841 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-6a532cde-db69-4381-8ea6-1bd7f983aa80 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:32.542175 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6a532cde-db69-4381-8ea6-1bd7f983aa80 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:32.542669 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6a532cde-db69-4381-8ea6-1bd7f983aa80 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:32.543115 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6a532cde-db69-4381-8ea6-1bd7f983aa80 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:32.543858 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6a532cde-db69-4381-8ea6-1bd7f983aa80 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:32.544351 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6a532cde-db69-4381-8ea6-1bd7f983aa80 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:32.544741 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6a532cde-db69-4381-8ea6-1bd7f983aa80 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:32.694890 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-6a532cde-db69-4381-8ea6-1bd7f983aa80 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:32.703225 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-6a532cde-db69-4381-8ea6-1bd7f983aa80 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1724 microversion: 2.1 time: 0.173058 Aug 11 11:06:32.704082 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 188/376] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:32 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:33.303218 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-b6bb620a-e686-4a14-b028-e4639f3db762 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:33.303894 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-b6bb620a-e686-4a14-b028-e4639f3db762 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] [instance: 0762660d-ef9c-4c5d-9f82-6d679b066641] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:33.310748 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b6bb620a-e686-4a14-b028-e4639f3db762 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:33.311412 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b6bb620a-e686-4a14-b028-e4639f3db762 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:33.311885 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b6bb620a-e686-4a14-b028-e4639f3db762 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:33.312689 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b6bb620a-e686-4a14-b028-e4639f3db762 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:33.313151 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b6bb620a-e686-4a14-b028-e4639f3db762 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:33.313582 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b6bb620a-e686-4a14-b028-e4639f3db762 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:33.340123 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-e0beda52-be1c-449f-8391-18a259e7f385 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:33.341624 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-e0beda52-be1c-449f-8391-18a259e7f385 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] [instance: 3794302e-1657-4edd-9e15-a78592597d5b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:33.364824 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e0beda52-be1c-449f-8391-18a259e7f385 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:33.365167 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e0beda52-be1c-449f-8391-18a259e7f385 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:33.365366 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e0beda52-be1c-449f-8391-18a259e7f385 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:33.366076 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e0beda52-be1c-449f-8391-18a259e7f385 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:33.366522 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e0beda52-be1c-449f-8391-18a259e7f385 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:33.366941 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e0beda52-be1c-449f-8391-18a259e7f385 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:33.547649 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-b6bb620a-e686-4a14-b028-e4639f3db762 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c727b8f265774a4bb03d8425212e7540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83857835f34141f18a89c759631878f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:33.556226 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-b6bb620a-e686-4a14-b028-e4639f3db762 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] 10.222.0.48 "GET /compute/v2.1/servers/0762660d-ef9c-4c5d-9f82-6d679b066641" status: 200 len: 1314 microversion: 2.1 time: 0.257190 Aug 11 11:06:33.556948 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 189/377] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:33 2022] GET /compute/v2.1/servers/0762660d-ef9c-4c5d-9f82-6d679b066641 => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:33.561789 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-befcfffd-6979-4310-b216-5864d2d999e7 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:33.562505 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-befcfffd-6979-4310-b216-5864d2d999e7 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:33.568904 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-befcfffd-6979-4310-b216-5864d2d999e7 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:33.569748 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-befcfffd-6979-4310-b216-5864d2d999e7 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:33.570616 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-befcfffd-6979-4310-b216-5864d2d999e7 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:33.571600 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-befcfffd-6979-4310-b216-5864d2d999e7 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:33.572149 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-befcfffd-6979-4310-b216-5864d2d999e7 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:33.572760 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-befcfffd-6979-4310-b216-5864d2d999e7 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:33.574295 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-e0beda52-be1c-449f-8391-18a259e7f385 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfaf5a716c5b448f8e1274de2fad307c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233f1c55781b4099be6e250e664c4fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:33.584012 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-e0beda52-be1c-449f-8391-18a259e7f385 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] 10.222.0.48 "GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b" status: 200 len: 1358 microversion: 2.1 time: 0.247369 Aug 11 11:06:33.596608 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 189/378] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:33 2022] GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b => generated 1358 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:33.709721 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-befcfffd-6979-4310-b216-5864d2d999e7 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:33.717686 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-befcfffd-6979-4310-b216-5864d2d999e7 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:33.719200 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-befcfffd-6979-4310-b216-5864d2d999e7 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:33.720383 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-befcfffd-6979-4310-b216-5864d2d999e7 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1737 microversion: 2.20 time: 0.162430 Aug 11 11:06:33.729503 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 190/379] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:06:33 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:06:33.729699 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-f8ce47ea-16f0-4446-8c97-cbc151b6aef9 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:33.729699 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-f8ce47ea-16f0-4446-8c97-cbc151b6aef9 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:33.733456 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f8ce47ea-16f0-4446-8c97-cbc151b6aef9 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:33.733940 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f8ce47ea-16f0-4446-8c97-cbc151b6aef9 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:33.734369 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f8ce47ea-16f0-4446-8c97-cbc151b6aef9 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:33.735052 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f8ce47ea-16f0-4446-8c97-cbc151b6aef9 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:33.735529 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f8ce47ea-16f0-4446-8c97-cbc151b6aef9 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:33.736282 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f8ce47ea-16f0-4446-8c97-cbc151b6aef9 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:33.874083 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-f8ce47ea-16f0-4446-8c97-cbc151b6aef9 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:33.882071 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-f8ce47ea-16f0-4446-8c97-cbc151b6aef9 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1724 microversion: 2.1 time: 0.159824 Aug 11 11:06:33.882648 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 190/380] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:33 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:34.441478 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-eeab4dae-fced-4b13-832f-a66892c529c2 req-5db2a85c-c045-43ab-b01e-ae2937e33649 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0762660d-ef9c-4c5d-9f82-6d679b066641", "name": "network-vif-plugged", "status": "completed", "tag": "0b55ba06-1442-4212-8bed-52450c407f97"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:06:34.454113 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-eeab4dae-fced-4b13-832f-a66892c529c2 req-5db2a85c-c045-43ab-b01e-ae2937e33649 service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:34.454596 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-eeab4dae-fced-4b13-832f-a66892c529c2 req-5db2a85c-c045-43ab-b01e-ae2937e33649 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:34.455025 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-eeab4dae-fced-4b13-832f-a66892c529c2 req-5db2a85c-c045-43ab-b01e-ae2937e33649 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:34.466583 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-eeab4dae-fced-4b13-832f-a66892c529c2 req-5db2a85c-c045-43ab-b01e-ae2937e33649 service nova] Creating event network-vif-plugged:0b55ba06-1442-4212-8bed-52450c407f97 for instance 0762660d-ef9c-4c5d-9f82-6d679b066641 on hv-cinder-82002 Aug 11 11:06:34.472677 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-eeab4dae-fced-4b13-832f-a66892c529c2 req-5db2a85c-c045-43ab-b01e-ae2937e33649 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034872 Aug 11 11:06:34.473609 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 191/381] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:06:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:06:34.576318 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-cb0faf5f-22bd-4f36-9b77-ef9891f71b78 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:34.578120 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-cb0faf5f-22bd-4f36-9b77-ef9891f71b78 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] [instance: 0762660d-ef9c-4c5d-9f82-6d679b066641] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:34.597476 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-cb0faf5f-22bd-4f36-9b77-ef9891f71b78 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:34.598316 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-cb0faf5f-22bd-4f36-9b77-ef9891f71b78 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:34.605584 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-cb0faf5f-22bd-4f36-9b77-ef9891f71b78 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:34.608848 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-cb0faf5f-22bd-4f36-9b77-ef9891f71b78 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:34.608848 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-cb0faf5f-22bd-4f36-9b77-ef9891f71b78 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:34.608848 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-cb0faf5f-22bd-4f36-9b77-ef9891f71b78 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:34.611438 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-a11cd010-451e-4fde-bd6d-788449aaf5d0 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:34.612480 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-a11cd010-451e-4fde-bd6d-788449aaf5d0 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] [instance: 3794302e-1657-4edd-9e15-a78592597d5b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:34.636910 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a11cd010-451e-4fde-bd6d-788449aaf5d0 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:34.638314 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a11cd010-451e-4fde-bd6d-788449aaf5d0 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:34.639662 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a11cd010-451e-4fde-bd6d-788449aaf5d0 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:34.640728 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a11cd010-451e-4fde-bd6d-788449aaf5d0 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:34.641418 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a11cd010-451e-4fde-bd6d-788449aaf5d0 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:34.642071 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a11cd010-451e-4fde-bd6d-788449aaf5d0 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:34.864408 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-cb0faf5f-22bd-4f36-9b77-ef9891f71b78 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c727b8f265774a4bb03d8425212e7540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83857835f34141f18a89c759631878f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:34.876261 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-cb0faf5f-22bd-4f36-9b77-ef9891f71b78 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] 10.222.0.48 "GET /compute/v2.1/servers/0762660d-ef9c-4c5d-9f82-6d679b066641" status: 200 len: 1314 microversion: 2.1 time: 0.303796 Aug 11 11:06:34.877176 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 191/382] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:34 2022] GET /compute/v2.1/servers/0762660d-ef9c-4c5d-9f82-6d679b066641 => generated 1314 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:34.882806 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-feeda3c7-ef67-41ea-9f66-6d08c92294e2 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:34.883481 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-feeda3c7-ef67-41ea-9f66-6d08c92294e2 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:34.891404 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-feeda3c7-ef67-41ea-9f66-6d08c92294e2 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:34.893369 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-feeda3c7-ef67-41ea-9f66-6d08c92294e2 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:34.893369 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-feeda3c7-ef67-41ea-9f66-6d08c92294e2 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:34.893369 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-feeda3c7-ef67-41ea-9f66-6d08c92294e2 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:34.893807 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-feeda3c7-ef67-41ea-9f66-6d08c92294e2 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:34.894957 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-feeda3c7-ef67-41ea-9f66-6d08c92294e2 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:34.910913 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-a11cd010-451e-4fde-bd6d-788449aaf5d0 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfaf5a716c5b448f8e1274de2fad307c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233f1c55781b4099be6e250e664c4fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:34.930921 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-a11cd010-451e-4fde-bd6d-788449aaf5d0 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] 10.222.0.48 "GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b" status: 200 len: 1358 microversion: 2.1 time: 0.324923 Aug 11 11:06:34.931720 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 192/383] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:34 2022] GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b => generated 1358 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:34.939631 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-5fd6e26e-2963-4923-b62f-8d6b758b6c04 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:34.940341 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-5fd6e26e-2963-4923-b62f-8d6b758b6c04 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:34.952639 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5fd6e26e-2963-4923-b62f-8d6b758b6c04 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:34.953438 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5fd6e26e-2963-4923-b62f-8d6b758b6c04 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:34.954146 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5fd6e26e-2963-4923-b62f-8d6b758b6c04 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:34.955153 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5fd6e26e-2963-4923-b62f-8d6b758b6c04 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:34.955848 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5fd6e26e-2963-4923-b62f-8d6b758b6c04 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:34.956529 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5fd6e26e-2963-4923-b62f-8d6b758b6c04 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:35.114648 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-feeda3c7-ef67-41ea-9f66-6d08c92294e2 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:35.123930 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-feeda3c7-ef67-41ea-9f66-6d08c92294e2 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:35.125611 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-feeda3c7-ef67-41ea-9f66-6d08c92294e2 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:35.126896 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-feeda3c7-ef67-41ea-9f66-6d08c92294e2 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1737 microversion: 2.20 time: 0.248693 Aug 11 11:06:35.127669 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 192/384] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:06:34 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1737 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:06:35.166764 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-5fd6e26e-2963-4923-b62f-8d6b758b6c04 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:35.178406 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-5fd6e26e-2963-4923-b62f-8d6b758b6c04 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1724 microversion: 2.1 time: 0.244663 Aug 11 11:06:35.179412 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 193/385] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:34 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1724 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:35.902534 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-27132a37-1e49-4083-bc34-0706cbeffacd tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:35.903166 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-27132a37-1e49-4083-bc34-0706cbeffacd tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] [instance: 0762660d-ef9c-4c5d-9f82-6d679b066641] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:35.911095 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-27132a37-1e49-4083-bc34-0706cbeffacd tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:35.911589 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-27132a37-1e49-4083-bc34-0706cbeffacd tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:35.912085 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-27132a37-1e49-4083-bc34-0706cbeffacd tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:35.912724 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-27132a37-1e49-4083-bc34-0706cbeffacd tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:35.913167 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-27132a37-1e49-4083-bc34-0706cbeffacd tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:35.913579 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-27132a37-1e49-4083-bc34-0706cbeffacd tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:35.953757 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-61130441-358d-4708-9e4e-b3932319fbd6 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:35.954542 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-61130441-358d-4708-9e4e-b3932319fbd6 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] [instance: 3794302e-1657-4edd-9e15-a78592597d5b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:35.961284 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-61130441-358d-4708-9e4e-b3932319fbd6 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:35.971125 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-61130441-358d-4708-9e4e-b3932319fbd6 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:35.971125 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-61130441-358d-4708-9e4e-b3932319fbd6 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:35.971125 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-61130441-358d-4708-9e4e-b3932319fbd6 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:35.971125 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-61130441-358d-4708-9e4e-b3932319fbd6 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:35.971597 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-61130441-358d-4708-9e4e-b3932319fbd6 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:36.139414 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-27132a37-1e49-4083-bc34-0706cbeffacd tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c727b8f265774a4bb03d8425212e7540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83857835f34141f18a89c759631878f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:36.148177 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-27132a37-1e49-4083-bc34-0706cbeffacd tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] 10.222.0.48 "GET /compute/v2.1/servers/0762660d-ef9c-4c5d-9f82-6d679b066641" status: 200 len: 1314 microversion: 2.1 time: 0.253233 Aug 11 11:06:36.148763 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 193/386] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:35 2022] GET /compute/v2.1/servers/0762660d-ef9c-4c5d-9f82-6d679b066641 => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:36.153787 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-bdea8410-37f8-4166-9125-14918c29241c tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:36.155105 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-bdea8410-37f8-4166-9125-14918c29241c tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:36.161259 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-bdea8410-37f8-4166-9125-14918c29241c tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:36.167276 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-bdea8410-37f8-4166-9125-14918c29241c tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:36.167276 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-bdea8410-37f8-4166-9125-14918c29241c tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:36.167276 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-bdea8410-37f8-4166-9125-14918c29241c tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:36.167276 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-bdea8410-37f8-4166-9125-14918c29241c tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:36.167671 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-bdea8410-37f8-4166-9125-14918c29241c tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:36.181716 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-61130441-358d-4708-9e4e-b3932319fbd6 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfaf5a716c5b448f8e1274de2fad307c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233f1c55781b4099be6e250e664c4fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:36.196997 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-61130441-358d-4708-9e4e-b3932319fbd6 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] 10.222.0.48 "GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b" status: 200 len: 1358 microversion: 2.1 time: 0.241314 Aug 11 11:06:36.196997 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 194/387] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:35 2022] GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b => generated 1358 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:06:36.210312 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-a453c6d6-e3f0-48b6-897c-7aa3a22e7397 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:36.210935 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-a453c6d6-e3f0-48b6-897c-7aa3a22e7397 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:36.217467 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a453c6d6-e3f0-48b6-897c-7aa3a22e7397 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:36.218192 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a453c6d6-e3f0-48b6-897c-7aa3a22e7397 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:36.218803 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a453c6d6-e3f0-48b6-897c-7aa3a22e7397 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:36.219679 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a453c6d6-e3f0-48b6-897c-7aa3a22e7397 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:36.220322 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a453c6d6-e3f0-48b6-897c-7aa3a22e7397 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:36.220754 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a453c6d6-e3f0-48b6-897c-7aa3a22e7397 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:36.408210 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-bdea8410-37f8-4166-9125-14918c29241c tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:36.416367 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-bdea8410-37f8-4166-9125-14918c29241c tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:36.417948 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-bdea8410-37f8-4166-9125-14918c29241c tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:36.419156 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-bdea8410-37f8-4166-9125-14918c29241c tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1737 microversion: 2.20 time: 0.269104 Aug 11 11:06:36.419717 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 194/388] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:06:36 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1737 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:06:36.436626 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-a453c6d6-e3f0-48b6-897c-7aa3a22e7397 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:36.445470 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-a453c6d6-e3f0-48b6-897c-7aa3a22e7397 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1724 microversion: 2.1 time: 0.240278 Aug 11 11:06:36.446060 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 195/389] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:36 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1724 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:37.169619 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-630e4897-b56f-4d62-8218-8bf287880290 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:37.170987 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-630e4897-b56f-4d62-8218-8bf287880290 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] [instance: 0762660d-ef9c-4c5d-9f82-6d679b066641] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:37.178840 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-630e4897-b56f-4d62-8218-8bf287880290 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:37.180756 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-630e4897-b56f-4d62-8218-8bf287880290 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:37.180756 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-630e4897-b56f-4d62-8218-8bf287880290 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:37.180756 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-630e4897-b56f-4d62-8218-8bf287880290 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:37.181045 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-630e4897-b56f-4d62-8218-8bf287880290 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:37.181444 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-630e4897-b56f-4d62-8218-8bf287880290 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:37.217271 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-77dc171b-477b-460e-80c0-d1cfedeb78ee tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:37.218173 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-77dc171b-477b-460e-80c0-d1cfedeb78ee tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] [instance: 3794302e-1657-4edd-9e15-a78592597d5b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:37.226824 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-77dc171b-477b-460e-80c0-d1cfedeb78ee tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:37.227316 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-77dc171b-477b-460e-80c0-d1cfedeb78ee tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:37.227754 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-77dc171b-477b-460e-80c0-d1cfedeb78ee tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:37.228587 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-77dc171b-477b-460e-80c0-d1cfedeb78ee tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:37.229050 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-77dc171b-477b-460e-80c0-d1cfedeb78ee tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:37.229501 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-77dc171b-477b-460e-80c0-d1cfedeb78ee tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:37.394247 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-630e4897-b56f-4d62-8218-8bf287880290 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c727b8f265774a4bb03d8425212e7540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83857835f34141f18a89c759631878f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:37.403332 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-630e4897-b56f-4d62-8218-8bf287880290 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] 10.222.0.48 "GET /compute/v2.1/servers/0762660d-ef9c-4c5d-9f82-6d679b066641" status: 200 len: 1314 microversion: 2.1 time: 0.237458 Aug 11 11:06:37.418236 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-77dc171b-477b-460e-80c0-d1cfedeb78ee tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfaf5a716c5b448f8e1274de2fad307c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233f1c55781b4099be6e250e664c4fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:37.419043 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 195/390] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:37 2022] GET /compute/v2.1/servers/0762660d-ef9c-4c5d-9f82-6d679b066641 => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:37.426990 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-77dc171b-477b-460e-80c0-d1cfedeb78ee tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] 10.222.0.48 "GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b" status: 200 len: 1358 microversion: 2.1 time: 0.213820 Aug 11 11:06:37.428364 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 196/391] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:37 2022] GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b => generated 1358 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:06:37.444155 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-ba4d7ccd-69c8-4833-b07f-84b69db6ebf1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:37.445050 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-ba4d7ccd-69c8-4833-b07f-84b69db6ebf1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:37.453421 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ba4d7ccd-69c8-4833-b07f-84b69db6ebf1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:37.454186 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ba4d7ccd-69c8-4833-b07f-84b69db6ebf1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:37.454928 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ba4d7ccd-69c8-4833-b07f-84b69db6ebf1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:37.456107 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ba4d7ccd-69c8-4833-b07f-84b69db6ebf1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:37.456723 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ba4d7ccd-69c8-4833-b07f-84b69db6ebf1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:37.457245 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ba4d7ccd-69c8-4833-b07f-84b69db6ebf1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:37.472654 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-9511cd22-001f-49c7-938c-598728f0d66c tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:37.473362 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-9511cd22-001f-49c7-938c-598728f0d66c tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:37.495113 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9511cd22-001f-49c7-938c-598728f0d66c tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:37.496118 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9511cd22-001f-49c7-938c-598728f0d66c tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:37.496941 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9511cd22-001f-49c7-938c-598728f0d66c tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:37.498055 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9511cd22-001f-49c7-938c-598728f0d66c tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:37.503999 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9511cd22-001f-49c7-938c-598728f0d66c tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:37.512231 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9511cd22-001f-49c7-938c-598728f0d66c tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:37.683628 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-ba4d7ccd-69c8-4833-b07f-84b69db6ebf1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:37.693868 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-ba4d7ccd-69c8-4833-b07f-84b69db6ebf1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:37.702534 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-ba4d7ccd-69c8-4833-b07f-84b69db6ebf1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:37.702534 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-ba4d7ccd-69c8-4833-b07f-84b69db6ebf1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1737 microversion: 2.20 time: 0.258432 Aug 11 11:06:37.702534 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 196/392] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:06:37 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1737 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:06:37.735168 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-9511cd22-001f-49c7-938c-598728f0d66c tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:37.741900 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-9511cd22-001f-49c7-938c-598728f0d66c tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1701 microversion: 2.1 time: 0.278337 Aug 11 11:06:37.742664 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 197/393] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:37 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1701 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:06:37.767013 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-a4c902ea-b258-4a15-a3bd-31cdd79633dc tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:06:37.773933 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a4c902ea-b258-4a15-a3bd-31cdd79633dc tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:37.774438 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a4c902ea-b258-4a15-a3bd-31cdd79633dc tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:37.774897 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a4c902ea-b258-4a15-a3bd-31cdd79633dc tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:37.839330 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-a4c902ea-b258-4a15-a3bd-31cdd79633dc tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Going to try to start instance {{(pid=121231) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 11 11:06:37.925259 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:38.058433 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-a4c902ea-b258-4a15-a3bd-31cdd79633dc tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "POST /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935/action" status: 202 len: 0 microversion: 2.1 time: 0.295524 Aug 11 11:06:38.062736 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 197/394] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Aug 11 11:06:37 2022] POST /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935/action => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 11:06:38.068222 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-a94cf537-0270-4366-a427-9a82800d5921 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:38.068825 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-a94cf537-0270-4366-a427-9a82800d5921 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:38.074834 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a94cf537-0270-4366-a427-9a82800d5921 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:38.075314 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a94cf537-0270-4366-a427-9a82800d5921 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:38.075747 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a94cf537-0270-4366-a427-9a82800d5921 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:38.076957 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a94cf537-0270-4366-a427-9a82800d5921 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:38.077403 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a94cf537-0270-4366-a427-9a82800d5921 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:38.077865 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a94cf537-0270-4366-a427-9a82800d5921 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:38.117350 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-74e21ab5-476a-4e4f-b5f0-4ba2c6f3f4ba tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:38.117931 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-74e21ab5-476a-4e4f-b5f0-4ba2c6f3f4ba tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] [instance: b2d65671-2e58-41ac-9aa1-245420900315] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:38.124481 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-74e21ab5-476a-4e4f-b5f0-4ba2c6f3f4ba tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:38.124970 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-74e21ab5-476a-4e4f-b5f0-4ba2c6f3f4ba tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:38.128824 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-74e21ab5-476a-4e4f-b5f0-4ba2c6f3f4ba tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:38.128824 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-74e21ab5-476a-4e4f-b5f0-4ba2c6f3f4ba tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:38.128824 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-74e21ab5-476a-4e4f-b5f0-4ba2c6f3f4ba tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:38.128824 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-74e21ab5-476a-4e4f-b5f0-4ba2c6f3f4ba tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:38.210632 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-a94cf537-0270-4366-a427-9a82800d5921 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:38.219452 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-a94cf537-0270-4366-a427-9a82800d5921 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1710 microversion: 2.1 time: 0.155373 Aug 11 11:06:38.220117 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 198/395] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:38 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1710 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:38.253579 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.objects.instance [None req-74e21ab5-476a-4e4f-b5f0-4ba2c6f3f4ba tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lazy-loading 'services' on Instance uuid b2d65671-2e58-41ac-9aa1-245420900315 {{(pid=121231) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 11:06:38.425684 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-59699920-a2bd-4731-8ef5-7d4ef2456f86 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:38.426156 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-59699920-a2bd-4731-8ef5-7d4ef2456f86 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] [instance: 0762660d-ef9c-4c5d-9f82-6d679b066641] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:38.432269 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-59699920-a2bd-4731-8ef5-7d4ef2456f86 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:38.432763 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-59699920-a2bd-4731-8ef5-7d4ef2456f86 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:38.433178 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-59699920-a2bd-4731-8ef5-7d4ef2456f86 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:38.433891 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-59699920-a2bd-4731-8ef5-7d4ef2456f86 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:38.434341 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-59699920-a2bd-4731-8ef5-7d4ef2456f86 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:38.434760 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-59699920-a2bd-4731-8ef5-7d4ef2456f86 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:38.511399 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-74e21ab5-476a-4e4f-b5f0-4ba2c6f3f4ba tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b2d65671-2e58-41ac-9aa1-245420900315/os-volume_attachments/ab1d6ce4-6b0c-42e9-a080-8ea66f414772" status: 202 len: 0 microversion: 2.1 time: 0.398135 Aug 11 11:06:38.511974 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 198/396] 10.222.0.48 () {58 vars in 1416 bytes} [Thu Aug 11 11:06:38 2022] DELETE /compute/v2.1/servers/b2d65671-2e58-41ac-9aa1-245420900315/os-volume_attachments/ab1d6ce4-6b0c-42e9-a080-8ea66f414772 => generated 0 bytes in 400 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 11 11:06:38.518223 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-1ec21901-c786-41ac-90c0-04a42209dde7 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:38.523215 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-1ec21901-c786-41ac-90c0-04a42209dde7 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] [instance: 3794302e-1657-4edd-9e15-a78592597d5b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:38.526231 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1ec21901-c786-41ac-90c0-04a42209dde7 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:38.527334 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1ec21901-c786-41ac-90c0-04a42209dde7 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:38.528234 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1ec21901-c786-41ac-90c0-04a42209dde7 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:38.528941 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1ec21901-c786-41ac-90c0-04a42209dde7 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:38.529547 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1ec21901-c786-41ac-90c0-04a42209dde7 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:38.529985 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1ec21901-c786-41ac-90c0-04a42209dde7 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:38.635982 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-59699920-a2bd-4731-8ef5-7d4ef2456f86 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c727b8f265774a4bb03d8425212e7540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83857835f34141f18a89c759631878f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:38.644583 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-59699920-a2bd-4731-8ef5-7d4ef2456f86 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] 10.222.0.48 "GET /compute/v2.1/servers/0762660d-ef9c-4c5d-9f82-6d679b066641" status: 200 len: 1314 microversion: 2.1 time: 0.223468 Aug 11 11:06:38.645168 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 199/397] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:38 2022] GET /compute/v2.1/servers/0762660d-ef9c-4c5d-9f82-6d679b066641 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:06:38.695896 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-1ec21901-c786-41ac-90c0-04a42209dde7 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfaf5a716c5b448f8e1274de2fad307c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233f1c55781b4099be6e250e664c4fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:38.704023 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-1ec21901-c786-41ac-90c0-04a42209dde7 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] 10.222.0.48 "GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b" status: 200 len: 1358 microversion: 2.1 time: 0.190590 Aug 11 11:06:38.704579 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 199/398] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:38 2022] GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b => generated 1358 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:38.721818 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-9241783d-5da7-44b5-9549-5b9a0dbfd31b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:38.722427 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-9241783d-5da7-44b5-9549-5b9a0dbfd31b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:38.728459 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9241783d-5da7-44b5-9549-5b9a0dbfd31b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:38.728945 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9241783d-5da7-44b5-9549-5b9a0dbfd31b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:38.729383 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9241783d-5da7-44b5-9549-5b9a0dbfd31b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:38.730071 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9241783d-5da7-44b5-9549-5b9a0dbfd31b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:38.730529 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9241783d-5da7-44b5-9549-5b9a0dbfd31b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:38.730956 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9241783d-5da7-44b5-9549-5b9a0dbfd31b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:38.865374 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-9241783d-5da7-44b5-9549-5b9a0dbfd31b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:38.874145 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-9241783d-5da7-44b5-9549-5b9a0dbfd31b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:38.875659 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-9241783d-5da7-44b5-9549-5b9a0dbfd31b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:38.876896 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-9241783d-5da7-44b5-9549-5b9a0dbfd31b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1719 microversion: 2.20 time: 0.158933 Aug 11 11:06:38.877481 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 200/399] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:06:38 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1719 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:06:39.242708 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-b6a554a9-7f26-40a0-a5f9-c9dc845fb854 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:39.243305 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-b6a554a9-7f26-40a0-a5f9-c9dc845fb854 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:39.249731 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b6a554a9-7f26-40a0-a5f9-c9dc845fb854 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:39.250206 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b6a554a9-7f26-40a0-a5f9-c9dc845fb854 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:39.250637 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b6a554a9-7f26-40a0-a5f9-c9dc845fb854 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:39.251319 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b6a554a9-7f26-40a0-a5f9-c9dc845fb854 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:39.251885 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b6a554a9-7f26-40a0-a5f9-c9dc845fb854 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:39.252300 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b6a554a9-7f26-40a0-a5f9-c9dc845fb854 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:39.389947 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-b6a554a9-7f26-40a0-a5f9-c9dc845fb854 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:39.397775 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-b6a554a9-7f26-40a0-a5f9-c9dc845fb854 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1710 microversion: 2.1 time: 0.159336 Aug 11 11:06:39.398336 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 200/400] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:39 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1710 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:39.665921 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-fa96c180-aff7-42df-beeb-64a6c0c35769 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:39.666639 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-fa96c180-aff7-42df-beeb-64a6c0c35769 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] [instance: 0762660d-ef9c-4c5d-9f82-6d679b066641] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:39.673602 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fa96c180-aff7-42df-beeb-64a6c0c35769 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:39.674220 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fa96c180-aff7-42df-beeb-64a6c0c35769 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:39.674770 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fa96c180-aff7-42df-beeb-64a6c0c35769 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:39.675535 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fa96c180-aff7-42df-beeb-64a6c0c35769 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:39.676042 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fa96c180-aff7-42df-beeb-64a6c0c35769 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:39.676492 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fa96c180-aff7-42df-beeb-64a6c0c35769 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:39.726324 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-822d106a-c05f-4895-8a5c-e247a3562628 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:39.727101 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-822d106a-c05f-4895-8a5c-e247a3562628 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] [instance: 3794302e-1657-4edd-9e15-a78592597d5b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:39.733573 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-822d106a-c05f-4895-8a5c-e247a3562628 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:39.734172 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-822d106a-c05f-4895-8a5c-e247a3562628 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:39.734717 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-822d106a-c05f-4895-8a5c-e247a3562628 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:39.735569 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-822d106a-c05f-4895-8a5c-e247a3562628 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:39.736078 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-822d106a-c05f-4895-8a5c-e247a3562628 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:39.736537 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-822d106a-c05f-4895-8a5c-e247a3562628 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:39.871008 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-fa96c180-aff7-42df-beeb-64a6c0c35769 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c727b8f265774a4bb03d8425212e7540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83857835f34141f18a89c759631878f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:39.878535 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-fa96c180-aff7-42df-beeb-64a6c0c35769 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] 10.222.0.48 "GET /compute/v2.1/servers/0762660d-ef9c-4c5d-9f82-6d679b066641" status: 200 len: 1314 microversion: 2.1 time: 0.216809 Aug 11 11:06:39.879120 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 201/401] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:39 2022] GET /compute/v2.1/servers/0762660d-ef9c-4c5d-9f82-6d679b066641 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:39.910747 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-822d106a-c05f-4895-8a5c-e247a3562628 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfaf5a716c5b448f8e1274de2fad307c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233f1c55781b4099be6e250e664c4fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:39.919015 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-dd7e9ef4-73af-44c7-ae94-3f054208ce4b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:39.919622 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-dd7e9ef4-73af-44c7-ae94-3f054208ce4b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:39.926659 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dd7e9ef4-73af-44c7-ae94-3f054208ce4b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:39.927569 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-822d106a-c05f-4895-8a5c-e247a3562628 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] 10.222.0.48 "GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b" status: 200 len: 1358 microversion: 2.1 time: 0.204965 Aug 11 11:06:39.927732 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dd7e9ef4-73af-44c7-ae94-3f054208ce4b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:39.928208 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dd7e9ef4-73af-44c7-ae94-3f054208ce4b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:39.929052 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dd7e9ef4-73af-44c7-ae94-3f054208ce4b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:39.929542 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dd7e9ef4-73af-44c7-ae94-3f054208ce4b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:39.930031 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dd7e9ef4-73af-44c7-ae94-3f054208ce4b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:39.930222 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 201/402] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:39 2022] GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b => generated 1358 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:06:40.098845 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-dd7e9ef4-73af-44c7-ae94-3f054208ce4b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:40.108367 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-dd7e9ef4-73af-44c7-ae94-3f054208ce4b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:40.109936 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-dd7e9ef4-73af-44c7-ae94-3f054208ce4b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:40.111113 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-dd7e9ef4-73af-44c7-ae94-3f054208ce4b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1719 microversion: 2.20 time: 0.195970 Aug 11 11:06:40.111673 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 202/403] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:06:39 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1719 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:06:40.275779 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-631abfa6-7d2b-49eb-9e67-d9918bbf7155 req-4127a461-423d-4930-8c82-658a23802294 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82a61cf6-1f3f-4ced-9806-a06252b9b2cc", "name": "network-vif-unplugged", "status": "completed", "tag": "71bca2c4-19df-4dc2-ad61-c7058687c043"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:06:40.286848 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-631abfa6-7d2b-49eb-9e67-d9918bbf7155 req-4127a461-423d-4930-8c82-658a23802294 service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:40.287327 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-631abfa6-7d2b-49eb-9e67-d9918bbf7155 req-4127a461-423d-4930-8c82-658a23802294 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:40.287777 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-631abfa6-7d2b-49eb-9e67-d9918bbf7155 req-4127a461-423d-4930-8c82-658a23802294 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:40.301602 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-631abfa6-7d2b-49eb-9e67-d9918bbf7155 req-4127a461-423d-4930-8c82-658a23802294 service nova] Creating event network-vif-unplugged:71bca2c4-19df-4dc2-ad61-c7058687c043 for instance 82a61cf6-1f3f-4ced-9806-a06252b9b2cc on hv-cinder-82002 Aug 11 11:06:40.306765 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-631abfa6-7d2b-49eb-9e67-d9918bbf7155 req-4127a461-423d-4930-8c82-658a23802294 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035232 Aug 11 11:06:40.307336 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 202/404] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:06:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:06:40.420319 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-2c02eeff-c547-412c-b141-1b485437f97d tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:40.421110 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-2c02eeff-c547-412c-b141-1b485437f97d tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:40.432861 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2c02eeff-c547-412c-b141-1b485437f97d tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:40.433729 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2c02eeff-c547-412c-b141-1b485437f97d tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:40.434495 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2c02eeff-c547-412c-b141-1b485437f97d tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:40.435971 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2c02eeff-c547-412c-b141-1b485437f97d tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:40.436784 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2c02eeff-c547-412c-b141-1b485437f97d tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:40.437558 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2c02eeff-c547-412c-b141-1b485437f97d tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:40.593441 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-2c02eeff-c547-412c-b141-1b485437f97d tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:40.597027 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=100 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:40.602523 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-2c02eeff-c547-412c-b141-1b485437f97d tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1710 microversion: 2.1 time: 0.186765 Aug 11 11:06:40.603324 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 203/405] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:40 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1710 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:40.902307 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-ea9804bb-d7e6-4b28-b5dd-788acec9b8c1 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:40.903010 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-ea9804bb-d7e6-4b28-b5dd-788acec9b8c1 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] [instance: 0762660d-ef9c-4c5d-9f82-6d679b066641] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:40.909490 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ea9804bb-d7e6-4b28-b5dd-788acec9b8c1 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:40.909973 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ea9804bb-d7e6-4b28-b5dd-788acec9b8c1 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:40.910405 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ea9804bb-d7e6-4b28-b5dd-788acec9b8c1 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:40.911141 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ea9804bb-d7e6-4b28-b5dd-788acec9b8c1 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:40.911568 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ea9804bb-d7e6-4b28-b5dd-788acec9b8c1 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:40.912041 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ea9804bb-d7e6-4b28-b5dd-788acec9b8c1 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:40.949280 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-8872a8d0-9b6f-40e1-bcde-b0d753f96db1 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:40.949894 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-8872a8d0-9b6f-40e1-bcde-b0d753f96db1 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] [instance: 3794302e-1657-4edd-9e15-a78592597d5b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:40.957137 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8872a8d0-9b6f-40e1-bcde-b0d753f96db1 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:40.957646 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8872a8d0-9b6f-40e1-bcde-b0d753f96db1 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:40.958089 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8872a8d0-9b6f-40e1-bcde-b0d753f96db1 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:40.958788 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8872a8d0-9b6f-40e1-bcde-b0d753f96db1 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:40.959306 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8872a8d0-9b6f-40e1-bcde-b0d753f96db1 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:40.959816 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8872a8d0-9b6f-40e1-bcde-b0d753f96db1 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:41.174934 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-ea9804bb-d7e6-4b28-b5dd-788acec9b8c1 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c727b8f265774a4bb03d8425212e7540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83857835f34141f18a89c759631878f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:41.183208 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-ea9804bb-d7e6-4b28-b5dd-788acec9b8c1 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] 10.222.0.48 "GET /compute/v2.1/servers/0762660d-ef9c-4c5d-9f82-6d679b066641" status: 200 len: 1314 microversion: 2.1 time: 0.285288 Aug 11 11:06:41.184942 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 203/406] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:40 2022] GET /compute/v2.1/servers/0762660d-ef9c-4c5d-9f82-6d679b066641 => generated 1314 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:41.201256 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-8872a8d0-9b6f-40e1-bcde-b0d753f96db1 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfaf5a716c5b448f8e1274de2fad307c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233f1c55781b4099be6e250e664c4fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:41.202279 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-4f744045-3c7f-4b96-9727-6cb64f1d8fd5 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:41.202923 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-4f744045-3c7f-4b96-9727-6cb64f1d8fd5 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:41.206679 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:41.209645 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-8872a8d0-9b6f-40e1-bcde-b0d753f96db1 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] 10.222.0.48 "GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b" status: 200 len: 1358 microversion: 2.1 time: 0.264476 Aug 11 11:06:41.210095 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4f744045-3c7f-4b96-9727-6cb64f1d8fd5 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:41.210421 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 204/407] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:40 2022] GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b => generated 1358 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:06:41.210579 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4f744045-3c7f-4b96-9727-6cb64f1d8fd5 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:41.211182 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4f744045-3c7f-4b96-9727-6cb64f1d8fd5 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:41.212107 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4f744045-3c7f-4b96-9727-6cb64f1d8fd5 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:41.212727 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4f744045-3c7f-4b96-9727-6cb64f1d8fd5 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:41.213154 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4f744045-3c7f-4b96-9727-6cb64f1d8fd5 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:41.356871 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-4f744045-3c7f-4b96-9727-6cb64f1d8fd5 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:41.365480 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-4f744045-3c7f-4b96-9727-6cb64f1d8fd5 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:41.366995 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-4f744045-3c7f-4b96-9727-6cb64f1d8fd5 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:41.368179 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-4f744045-3c7f-4b96-9727-6cb64f1d8fd5 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1719 microversion: 2.20 time: 0.181207 Aug 11 11:06:41.368736 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 204/408] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:06:41 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1719 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:06:41.624120 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-2dc935fe-0583-473e-a9c3-287dfe48da73 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:41.624887 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-2dc935fe-0583-473e-a9c3-287dfe48da73 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:41.631226 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2dc935fe-0583-473e-a9c3-287dfe48da73 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:41.631828 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2dc935fe-0583-473e-a9c3-287dfe48da73 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:41.632341 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2dc935fe-0583-473e-a9c3-287dfe48da73 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:41.633113 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2dc935fe-0583-473e-a9c3-287dfe48da73 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:41.633640 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2dc935fe-0583-473e-a9c3-287dfe48da73 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:41.634176 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2dc935fe-0583-473e-a9c3-287dfe48da73 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:41.840049 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-2dc935fe-0583-473e-a9c3-287dfe48da73 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:41.849038 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-2dc935fe-0583-473e-a9c3-287dfe48da73 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1710 microversion: 2.1 time: 0.229860 Aug 11 11:06:41.859541 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 205/409] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:41 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1710 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:42.206160 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-7b9ebd23-ad12-4c4c-8014-24d2105fa2b4 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:42.207367 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-7b9ebd23-ad12-4c4c-8014-24d2105fa2b4 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] [instance: 0762660d-ef9c-4c5d-9f82-6d679b066641] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:42.215049 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7b9ebd23-ad12-4c4c-8014-24d2105fa2b4 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:42.215294 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7b9ebd23-ad12-4c4c-8014-24d2105fa2b4 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:42.215728 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7b9ebd23-ad12-4c4c-8014-24d2105fa2b4 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:42.216476 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7b9ebd23-ad12-4c4c-8014-24d2105fa2b4 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:42.216924 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7b9ebd23-ad12-4c4c-8014-24d2105fa2b4 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:42.217452 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7b9ebd23-ad12-4c4c-8014-24d2105fa2b4 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:42.230914 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-6a7683f7-5d06-4108-88cb-f79be4504f46 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:42.231754 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-6a7683f7-5d06-4108-88cb-f79be4504f46 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] [instance: 3794302e-1657-4edd-9e15-a78592597d5b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:42.240927 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6a7683f7-5d06-4108-88cb-f79be4504f46 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:42.246269 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6a7683f7-5d06-4108-88cb-f79be4504f46 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:42.246269 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6a7683f7-5d06-4108-88cb-f79be4504f46 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:42.246269 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6a7683f7-5d06-4108-88cb-f79be4504f46 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:42.246269 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6a7683f7-5d06-4108-88cb-f79be4504f46 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:42.246777 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6a7683f7-5d06-4108-88cb-f79be4504f46 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:42.425311 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-7b9ebd23-ad12-4c4c-8014-24d2105fa2b4 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c727b8f265774a4bb03d8425212e7540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83857835f34141f18a89c759631878f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:42.430711 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-6a7683f7-5d06-4108-88cb-f79be4504f46 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfaf5a716c5b448f8e1274de2fad307c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233f1c55781b4099be6e250e664c4fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:42.433858 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-7b9ebd23-ad12-4c4c-8014-24d2105fa2b4 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] 10.222.0.48 "GET /compute/v2.1/servers/0762660d-ef9c-4c5d-9f82-6d679b066641" status: 200 len: 1464 microversion: 2.1 time: 0.231580 Aug 11 11:06:42.450128 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 205/410] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:42 2022] GET /compute/v2.1/servers/0762660d-ef9c-4c5d-9f82-6d679b066641 => generated 1464 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:42.450128 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-b849f7d3-ca13-4514-be7a-483ac7cb21e8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:42.450441 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-6a7683f7-5d06-4108-88cb-f79be4504f46 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] 10.222.0.48 "GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b" status: 200 len: 1358 microversion: 2.1 time: 0.213158 Aug 11 11:06:42.450550 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-b849f7d3-ca13-4514-be7a-483ac7cb21e8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:42.450650 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 206/411] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:42 2022] GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b => generated 1358 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:06:42.450763 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b849f7d3-ca13-4514-be7a-483ac7cb21e8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:42.450763 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b849f7d3-ca13-4514-be7a-483ac7cb21e8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:42.450763 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b849f7d3-ca13-4514-be7a-483ac7cb21e8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:42.450763 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b849f7d3-ca13-4514-be7a-483ac7cb21e8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:42.451088 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b849f7d3-ca13-4514-be7a-483ac7cb21e8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:42.451088 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b849f7d3-ca13-4514-be7a-483ac7cb21e8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:42.482764 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-405e925b-429a-465c-ac00-3da2c5951a35 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:42.483360 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-405e925b-429a-465c-ac00-3da2c5951a35 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] [instance: 0762660d-ef9c-4c5d-9f82-6d679b066641] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:42.491281 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-405e925b-429a-465c-ac00-3da2c5951a35 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:42.492808 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-405e925b-429a-465c-ac00-3da2c5951a35 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:42.492808 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-405e925b-429a-465c-ac00-3da2c5951a35 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:42.493198 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-405e925b-429a-465c-ac00-3da2c5951a35 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:42.494049 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-405e925b-429a-465c-ac00-3da2c5951a35 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:42.494823 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-405e925b-429a-465c-ac00-3da2c5951a35 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:42.523707 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-405e925b-429a-465c-ac00-3da2c5951a35 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] [instance: 0762660d-ef9c-4c5d-9f82-6d679b066641] Going to try to terminate instance {{(pid=121232) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 11 11:06:42.665290 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-b849f7d3-ca13-4514-be7a-483ac7cb21e8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:42.674267 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-b849f7d3-ca13-4514-be7a-483ac7cb21e8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:42.676651 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-b849f7d3-ca13-4514-be7a-483ac7cb21e8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:42.677459 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-b849f7d3-ca13-4514-be7a-483ac7cb21e8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1719 microversion: 2.20 time: 0.241442 Aug 11 11:06:42.678003 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 206/412] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:06:42 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1719 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:06:42.866784 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-3ce501b6-d6ee-46ca-95a8-6e8628e1367a tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:42.867275 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-3ce501b6-d6ee-46ca-95a8-6e8628e1367a tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] [instance: b2d65671-2e58-41ac-9aa1-245420900315] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:42.873360 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3ce501b6-d6ee-46ca-95a8-6e8628e1367a tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:42.873837 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3ce501b6-d6ee-46ca-95a8-6e8628e1367a tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:42.874272 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3ce501b6-d6ee-46ca-95a8-6e8628e1367a tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:42.875003 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3ce501b6-d6ee-46ca-95a8-6e8628e1367a tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:42.875452 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3ce501b6-d6ee-46ca-95a8-6e8628e1367a tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:42.875898 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3ce501b6-d6ee-46ca-95a8-6e8628e1367a tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:42.889535 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-405e925b-429a-465c-ac00-3da2c5951a35 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] 10.222.0.48 "DELETE /compute/v2.1/servers/0762660d-ef9c-4c5d-9f82-6d679b066641" status: 204 len: 0 microversion: 2.1 time: 0.410594 Aug 11 11:06:42.890396 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 207/413] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Aug 11 11:06:42 2022] DELETE /compute/v2.1/servers/0762660d-ef9c-4c5d-9f82-6d679b066641 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 11 11:06:42.900551 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-9522f72f-d743-412f-ad05-a4581bf29bfa tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:42.901451 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-9522f72f-d743-412f-ad05-a4581bf29bfa tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:42.903300 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-3ce501b6-d6ee-46ca-95a8-6e8628e1367a tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] [instance: b2d65671-2e58-41ac-9aa1-245420900315] Going to try to terminate instance {{(pid=121231) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 11 11:06:42.909367 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9522f72f-d743-412f-ad05-a4581bf29bfa tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:42.910031 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9522f72f-d743-412f-ad05-a4581bf29bfa tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:42.910656 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9522f72f-d743-412f-ad05-a4581bf29bfa tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:42.911499 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9522f72f-d743-412f-ad05-a4581bf29bfa tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:42.912219 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9522f72f-d743-412f-ad05-a4581bf29bfa tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:42.912804 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9522f72f-d743-412f-ad05-a4581bf29bfa tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:43.049591 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-9522f72f-d743-412f-ad05-a4581bf29bfa tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:43.057823 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-9522f72f-d743-412f-ad05-a4581bf29bfa tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1710 microversion: 2.1 time: 0.162956 Aug 11 11:06:43.058697 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 208/414] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:42 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1710 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:43.064236 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-7a9e6561-d21b-4b0c-a25c-03750ff6ac8a tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:43.064236 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-7a9e6561-d21b-4b0c-a25c-03750ff6ac8a tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] [instance: 0762660d-ef9c-4c5d-9f82-6d679b066641] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:43.070287 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7a9e6561-d21b-4b0c-a25c-03750ff6ac8a tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:43.070845 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7a9e6561-d21b-4b0c-a25c-03750ff6ac8a tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:43.071276 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7a9e6561-d21b-4b0c-a25c-03750ff6ac8a tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:43.072452 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7a9e6561-d21b-4b0c-a25c-03750ff6ac8a tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:43.072452 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7a9e6561-d21b-4b0c-a25c-03750ff6ac8a tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:43.072894 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7a9e6561-d21b-4b0c-a25c-03750ff6ac8a tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:43.214322 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-7a9e6561-d21b-4b0c-a25c-03750ff6ac8a tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c727b8f265774a4bb03d8425212e7540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83857835f34141f18a89c759631878f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:43.222752 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-7a9e6561-d21b-4b0c-a25c-03750ff6ac8a tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] 10.222.0.48 "GET /compute/v2.1/servers/0762660d-ef9c-4c5d-9f82-6d679b066641" status: 200 len: 1470 microversion: 2.1 time: 0.163116 Aug 11 11:06:43.223481 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 209/415] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:43 2022] GET /compute/v2.1/servers/0762660d-ef9c-4c5d-9f82-6d679b066641 => generated 1470 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:43.312084 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-3ce501b6-d6ee-46ca-95a8-6e8628e1367a tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b2d65671-2e58-41ac-9aa1-245420900315" status: 204 len: 0 microversion: 2.1 time: 0.448977 Aug 11 11:06:43.312736 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 207/416] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Aug 11 11:06:42 2022] DELETE /compute/v2.1/servers/b2d65671-2e58-41ac-9aa1-245420900315 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 11 11:06:43.322667 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-02b2ed9b-4b3d-4448-9489-a323249cdc90 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:43.322667 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-02b2ed9b-4b3d-4448-9489-a323249cdc90 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] [instance: b2d65671-2e58-41ac-9aa1-245420900315] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:43.330259 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-02b2ed9b-4b3d-4448-9489-a323249cdc90 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:43.330778 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-02b2ed9b-4b3d-4448-9489-a323249cdc90 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:43.331237 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-02b2ed9b-4b3d-4448-9489-a323249cdc90 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:43.331956 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-02b2ed9b-4b3d-4448-9489-a323249cdc90 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:43.332403 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-02b2ed9b-4b3d-4448-9489-a323249cdc90 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:43.332819 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-02b2ed9b-4b3d-4448-9489-a323249cdc90 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:43.462776 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-cee3a969-060b-4aa0-9054-62cd7c4aa30f tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:43.463463 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-cee3a969-060b-4aa0-9054-62cd7c4aa30f tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] [instance: 3794302e-1657-4edd-9e15-a78592597d5b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:43.468951 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-02b2ed9b-4b3d-4448-9489-a323249cdc90 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7493d38d24493b3298ac37592ecd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c8a1db00944c59950120c030ab47e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:43.470704 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-cee3a969-060b-4aa0-9054-62cd7c4aa30f tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:43.471735 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-cee3a969-060b-4aa0-9054-62cd7c4aa30f tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:43.472476 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-cee3a969-060b-4aa0-9054-62cd7c4aa30f tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:43.473628 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-cee3a969-060b-4aa0-9054-62cd7c4aa30f tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:43.474417 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-cee3a969-060b-4aa0-9054-62cd7c4aa30f tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:43.475119 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-cee3a969-060b-4aa0-9054-62cd7c4aa30f tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:43.476904 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-02b2ed9b-4b3d-4448-9489-a323249cdc90 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] 10.222.0.48 "GET /compute/v2.1/servers/b2d65671-2e58-41ac-9aa1-245420900315" status: 200 len: 1514 microversion: 2.1 time: 0.159619 Aug 11 11:06:43.477476 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 210/417] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:43 2022] GET /compute/v2.1/servers/b2d65671-2e58-41ac-9aa1-245420900315 => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:43.621265 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-cee3a969-060b-4aa0-9054-62cd7c4aa30f tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfaf5a716c5b448f8e1274de2fad307c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233f1c55781b4099be6e250e664c4fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:43.629675 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-cee3a969-060b-4aa0-9054-62cd7c4aa30f tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] 10.222.0.48 "GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b" status: 200 len: 1358 microversion: 2.1 time: 0.171340 Aug 11 11:06:43.630423 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 208/418] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:43 2022] GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:06:43.701949 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-2fd35ad5-6548-418c-a872-47e91c9c5a20 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:43.702556 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-2fd35ad5-6548-418c-a872-47e91c9c5a20 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:43.708649 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2fd35ad5-6548-418c-a872-47e91c9c5a20 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:43.709133 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2fd35ad5-6548-418c-a872-47e91c9c5a20 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:43.709566 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2fd35ad5-6548-418c-a872-47e91c9c5a20 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:43.710250 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2fd35ad5-6548-418c-a872-47e91c9c5a20 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:43.710710 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2fd35ad5-6548-418c-a872-47e91c9c5a20 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:43.711132 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2fd35ad5-6548-418c-a872-47e91c9c5a20 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:43.847076 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-2fd35ad5-6548-418c-a872-47e91c9c5a20 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:43.855245 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-2fd35ad5-6548-418c-a872-47e91c9c5a20 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:43.857127 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-2fd35ad5-6548-418c-a872-47e91c9c5a20 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:43.858283 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-2fd35ad5-6548-418c-a872-47e91c9c5a20 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1719 microversion: 2.20 time: 0.160433 Aug 11 11:06:43.858840 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 211/419] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:06:43 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1719 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:06:44.080196 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-70ee4851-122a-44bc-8206-01446b9b1fe6 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:44.081047 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-70ee4851-122a-44bc-8206-01446b9b1fe6 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:44.086993 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-70ee4851-122a-44bc-8206-01446b9b1fe6 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:44.087470 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-70ee4851-122a-44bc-8206-01446b9b1fe6 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:44.087930 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-70ee4851-122a-44bc-8206-01446b9b1fe6 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:44.088613 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-70ee4851-122a-44bc-8206-01446b9b1fe6 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:44.089059 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-70ee4851-122a-44bc-8206-01446b9b1fe6 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:44.089475 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-70ee4851-122a-44bc-8206-01446b9b1fe6 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:44.246522 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-70ee4851-122a-44bc-8206-01446b9b1fe6 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:44.252299 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-2a4ee9b6-16a2-4e67-8196-c8b7f40dd37a tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:44.253049 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-2a4ee9b6-16a2-4e67-8196-c8b7f40dd37a tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] [instance: 0762660d-ef9c-4c5d-9f82-6d679b066641] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:44.257131 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-70ee4851-122a-44bc-8206-01446b9b1fe6 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1710 microversion: 2.1 time: 0.180682 Aug 11 11:06:44.258982 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 209/420] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:44 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1710 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:44.259499 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2a4ee9b6-16a2-4e67-8196-c8b7f40dd37a tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:44.260124 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2a4ee9b6-16a2-4e67-8196-c8b7f40dd37a tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:44.260694 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2a4ee9b6-16a2-4e67-8196-c8b7f40dd37a tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:44.261478 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2a4ee9b6-16a2-4e67-8196-c8b7f40dd37a tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:44.262074 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2a4ee9b6-16a2-4e67-8196-c8b7f40dd37a tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:44.262533 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2a4ee9b6-16a2-4e67-8196-c8b7f40dd37a tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:44.401686 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-2a4ee9b6-16a2-4e67-8196-c8b7f40dd37a tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c727b8f265774a4bb03d8425212e7540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83857835f34141f18a89c759631878f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:44.412173 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-2a4ee9b6-16a2-4e67-8196-c8b7f40dd37a tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] 10.222.0.48 "GET /compute/v2.1/servers/0762660d-ef9c-4c5d-9f82-6d679b066641" status: 200 len: 1470 microversion: 2.1 time: 0.163545 Aug 11 11:06:44.412801 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 212/421] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:44 2022] GET /compute/v2.1/servers/0762660d-ef9c-4c5d-9f82-6d679b066641 => generated 1470 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:06:44.499747 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-f64194ba-2d3d-450f-ac08-243b5a081679 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:44.504129 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-f64194ba-2d3d-450f-ac08-243b5a081679 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] [instance: b2d65671-2e58-41ac-9aa1-245420900315] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:44.506790 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f64194ba-2d3d-450f-ac08-243b5a081679 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:44.507278 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f64194ba-2d3d-450f-ac08-243b5a081679 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:44.507718 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f64194ba-2d3d-450f-ac08-243b5a081679 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:44.508448 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f64194ba-2d3d-450f-ac08-243b5a081679 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:44.508938 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f64194ba-2d3d-450f-ac08-243b5a081679 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:44.509323 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f64194ba-2d3d-450f-ac08-243b5a081679 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:44.651368 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-dae6d1e3-396d-465f-a299-766fe60e9cc4 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:44.652203 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-dae6d1e3-396d-465f-a299-766fe60e9cc4 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] [instance: 3794302e-1657-4edd-9e15-a78592597d5b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:44.658968 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dae6d1e3-396d-465f-a299-766fe60e9cc4 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:44.659445 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dae6d1e3-396d-465f-a299-766fe60e9cc4 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:44.659916 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dae6d1e3-396d-465f-a299-766fe60e9cc4 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:44.660654 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dae6d1e3-396d-465f-a299-766fe60e9cc4 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:44.661101 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dae6d1e3-396d-465f-a299-766fe60e9cc4 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:44.661516 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dae6d1e3-396d-465f-a299-766fe60e9cc4 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:44.685709 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-f64194ba-2d3d-450f-ac08-243b5a081679 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7493d38d24493b3298ac37592ecd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c8a1db00944c59950120c030ab47e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:44.696092 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-f64194ba-2d3d-450f-ac08-243b5a081679 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] 10.222.0.48 "GET /compute/v2.1/servers/b2d65671-2e58-41ac-9aa1-245420900315" status: 200 len: 1514 microversion: 2.1 time: 0.200925 Aug 11 11:06:44.708070 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 210/422] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:44 2022] GET /compute/v2.1/servers/b2d65671-2e58-41ac-9aa1-245420900315 => generated 1514 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:44.823677 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-dae6d1e3-396d-465f-a299-766fe60e9cc4 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfaf5a716c5b448f8e1274de2fad307c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233f1c55781b4099be6e250e664c4fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:44.831966 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-dae6d1e3-396d-465f-a299-766fe60e9cc4 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] 10.222.0.48 "GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b" status: 200 len: 1358 microversion: 2.1 time: 0.185293 Aug 11 11:06:44.832578 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 213/423] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:44 2022] GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:06:44.883819 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-24061244-6d14-4e1e-a3b5-f71899f34913 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:44.884428 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-24061244-6d14-4e1e-a3b5-f71899f34913 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:44.891207 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-24061244-6d14-4e1e-a3b5-f71899f34913 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:44.891754 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-24061244-6d14-4e1e-a3b5-f71899f34913 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:44.892229 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-24061244-6d14-4e1e-a3b5-f71899f34913 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:44.892946 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-24061244-6d14-4e1e-a3b5-f71899f34913 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:44.893401 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-24061244-6d14-4e1e-a3b5-f71899f34913 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:44.899069 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-24061244-6d14-4e1e-a3b5-f71899f34913 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:45.043036 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-24061244-6d14-4e1e-a3b5-f71899f34913 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:45.053701 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-24061244-6d14-4e1e-a3b5-f71899f34913 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:45.055821 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-24061244-6d14-4e1e-a3b5-f71899f34913 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:45.057585 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-24061244-6d14-4e1e-a3b5-f71899f34913 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1719 microversion: 2.20 time: 0.177855 Aug 11 11:06:45.058348 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 211/424] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:06:44 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1719 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:06:45.278365 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-e4a7a3b0-594c-4f8f-ad88-62622cce6a8f tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:45.279473 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-e4a7a3b0-594c-4f8f-ad88-62622cce6a8f tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:45.281552 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:45.286209 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e4a7a3b0-594c-4f8f-ad88-62622cce6a8f tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:45.286688 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e4a7a3b0-594c-4f8f-ad88-62622cce6a8f tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:45.287119 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e4a7a3b0-594c-4f8f-ad88-62622cce6a8f tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:45.287827 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e4a7a3b0-594c-4f8f-ad88-62622cce6a8f tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:45.288277 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e4a7a3b0-594c-4f8f-ad88-62622cce6a8f tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:45.288696 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e4a7a3b0-594c-4f8f-ad88-62622cce6a8f tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:45.415845 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-e4a7a3b0-594c-4f8f-ad88-62622cce6a8f tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:45.423661 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-e4a7a3b0-594c-4f8f-ad88-62622cce6a8f tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1714 microversion: 2.1 time: 0.149132 Aug 11 11:06:45.424253 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 214/425] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:45 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1714 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:45.433972 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-38a273c9-59de-4152-84ee-bc380f2c3821 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:45.434581 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-38a273c9-59de-4152-84ee-bc380f2c3821 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] [instance: 0762660d-ef9c-4c5d-9f82-6d679b066641] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:45.441704 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-38a273c9-59de-4152-84ee-bc380f2c3821 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:45.442186 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-38a273c9-59de-4152-84ee-bc380f2c3821 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:45.442618 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-38a273c9-59de-4152-84ee-bc380f2c3821 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:45.443305 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-38a273c9-59de-4152-84ee-bc380f2c3821 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:45.443792 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-38a273c9-59de-4152-84ee-bc380f2c3821 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:45.444207 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-38a273c9-59de-4152-84ee-bc380f2c3821 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:45.576037 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-38a273c9-59de-4152-84ee-bc380f2c3821 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c727b8f265774a4bb03d8425212e7540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83857835f34141f18a89c759631878f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:45.579618 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:45.584618 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-38a273c9-59de-4152-84ee-bc380f2c3821 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] 10.222.0.48 "GET /compute/v2.1/servers/0762660d-ef9c-4c5d-9f82-6d679b066641" status: 200 len: 1470 microversion: 2.1 time: 0.154624 Aug 11 11:06:45.585191 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 212/426] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:45 2022] GET /compute/v2.1/servers/0762660d-ef9c-4c5d-9f82-6d679b066641 => generated 1470 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:45.718759 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-bfc76d5a-9a7a-45eb-8c79-8544e1800f5b tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:45.719374 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-bfc76d5a-9a7a-45eb-8c79-8544e1800f5b tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] [instance: b2d65671-2e58-41ac-9aa1-245420900315] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:45.725636 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bfc76d5a-9a7a-45eb-8c79-8544e1800f5b tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:45.726123 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bfc76d5a-9a7a-45eb-8c79-8544e1800f5b tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:45.726560 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bfc76d5a-9a7a-45eb-8c79-8544e1800f5b tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:45.727301 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bfc76d5a-9a7a-45eb-8c79-8544e1800f5b tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:45.727773 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bfc76d5a-9a7a-45eb-8c79-8544e1800f5b tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:45.728213 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bfc76d5a-9a7a-45eb-8c79-8544e1800f5b tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:45.854362 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-1410d54a-4203-412b-a9cf-344e57814eed tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:45.855341 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-1410d54a-4203-412b-a9cf-344e57814eed tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] [instance: 3794302e-1657-4edd-9e15-a78592597d5b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:45.866487 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1410d54a-4203-412b-a9cf-344e57814eed tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:45.867056 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1410d54a-4203-412b-a9cf-344e57814eed tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:45.867575 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1410d54a-4203-412b-a9cf-344e57814eed tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:45.868370 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1410d54a-4203-412b-a9cf-344e57814eed tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:45.868897 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1410d54a-4203-412b-a9cf-344e57814eed tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:45.869394 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1410d54a-4203-412b-a9cf-344e57814eed tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:45.875309 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-bfc76d5a-9a7a-45eb-8c79-8544e1800f5b tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7493d38d24493b3298ac37592ecd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c8a1db00944c59950120c030ab47e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:45.883256 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-bfc76d5a-9a7a-45eb-8c79-8544e1800f5b tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] 10.222.0.48 "GET /compute/v2.1/servers/b2d65671-2e58-41ac-9aa1-245420900315" status: 200 len: 1514 microversion: 2.1 time: 0.168685 Aug 11 11:06:45.897874 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 215/427] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:45 2022] GET /compute/v2.1/servers/b2d65671-2e58-41ac-9aa1-245420900315 => generated 1514 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:46.006755 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-1410d54a-4203-412b-a9cf-344e57814eed tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfaf5a716c5b448f8e1274de2fad307c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233f1c55781b4099be6e250e664c4fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:46.015085 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-1410d54a-4203-412b-a9cf-344e57814eed tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] 10.222.0.48 "GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b" status: 200 len: 1358 microversion: 2.1 time: 0.164563 Aug 11 11:06:46.015648 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 213/428] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:45 2022] GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:06:46.081070 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-bc098d7b-a29d-4c79-b67b-2fd9ceeeb06b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:46.081670 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-bc098d7b-a29d-4c79-b67b-2fd9ceeeb06b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:46.087898 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bc098d7b-a29d-4c79-b67b-2fd9ceeeb06b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:46.088376 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bc098d7b-a29d-4c79-b67b-2fd9ceeeb06b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:46.088845 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bc098d7b-a29d-4c79-b67b-2fd9ceeeb06b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:46.089491 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bc098d7b-a29d-4c79-b67b-2fd9ceeeb06b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:46.089936 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bc098d7b-a29d-4c79-b67b-2fd9ceeeb06b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:46.090355 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bc098d7b-a29d-4c79-b67b-2fd9ceeeb06b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:46.224862 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-bc098d7b-a29d-4c79-b67b-2fd9ceeeb06b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:46.233076 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-bc098d7b-a29d-4c79-b67b-2fd9ceeeb06b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:46.234631 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-bc098d7b-a29d-4c79-b67b-2fd9ceeeb06b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:46.241138 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-bc098d7b-a29d-4c79-b67b-2fd9ceeeb06b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1719 microversion: 2.20 time: 0.158821 Aug 11 11:06:46.241138 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 216/429] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:06:46 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1719 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:06:46.401175 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-aa1bb72f-bfb7-4d97-b673-8337e49f61ff req-f2b012ec-0a75-4b86-9b1d-260f94b3c922 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3794302e-1657-4edd-9e15-a78592597d5b", "name": "network-vif-plugged", "status": "completed", "tag": "8d6a01cf-8904-414f-b58d-2be53d6e73d1"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:06:46.411254 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-aa1bb72f-bfb7-4d97-b673-8337e49f61ff req-f2b012ec-0a75-4b86-9b1d-260f94b3c922 service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:46.411836 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-aa1bb72f-bfb7-4d97-b673-8337e49f61ff req-f2b012ec-0a75-4b86-9b1d-260f94b3c922 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:46.412241 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-aa1bb72f-bfb7-4d97-b673-8337e49f61ff req-f2b012ec-0a75-4b86-9b1d-260f94b3c922 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:46.426057 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-aa1bb72f-bfb7-4d97-b673-8337e49f61ff req-f2b012ec-0a75-4b86-9b1d-260f94b3c922 service nova] Creating event network-vif-plugged:8d6a01cf-8904-414f-b58d-2be53d6e73d1 for instance 3794302e-1657-4edd-9e15-a78592597d5b on hv-cinder-82002 Aug 11 11:06:46.432168 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-aa1bb72f-bfb7-4d97-b673-8337e49f61ff req-f2b012ec-0a75-4b86-9b1d-260f94b3c922 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035338 Aug 11 11:06:46.432932 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 214/430] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:06:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:06:46.605452 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-79898780-0268-45a2-8b8d-901d9db76f52 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:46.606796 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-79898780-0268-45a2-8b8d-901d9db76f52 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] [instance: 0762660d-ef9c-4c5d-9f82-6d679b066641] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:46.613462 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-79898780-0268-45a2-8b8d-901d9db76f52 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:46.613954 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-79898780-0268-45a2-8b8d-901d9db76f52 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:46.614393 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-79898780-0268-45a2-8b8d-901d9db76f52 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:46.615097 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-79898780-0268-45a2-8b8d-901d9db76f52 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:46.615551 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-79898780-0268-45a2-8b8d-901d9db76f52 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:46.616025 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-79898780-0268-45a2-8b8d-901d9db76f52 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:46.757218 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-79898780-0268-45a2-8b8d-901d9db76f52 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c727b8f265774a4bb03d8425212e7540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83857835f34141f18a89c759631878f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:46.765970 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-79898780-0268-45a2-8b8d-901d9db76f52 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] 10.222.0.48 "GET /compute/v2.1/servers/0762660d-ef9c-4c5d-9f82-6d679b066641" status: 200 len: 1470 microversion: 2.1 time: 0.164315 Aug 11 11:06:46.766569 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 217/431] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:46 2022] GET /compute/v2.1/servers/0762660d-ef9c-4c5d-9f82-6d679b066641 => generated 1470 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:46.906705 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-d2e6f1b2-1b5b-4a43-9b1b-67d77607407e tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:46.907894 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-d2e6f1b2-1b5b-4a43-9b1b-67d77607407e tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] [instance: b2d65671-2e58-41ac-9aa1-245420900315] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:46.913869 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d2e6f1b2-1b5b-4a43-9b1b-67d77607407e tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:46.914429 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d2e6f1b2-1b5b-4a43-9b1b-67d77607407e tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:46.914866 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d2e6f1b2-1b5b-4a43-9b1b-67d77607407e tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:46.915563 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d2e6f1b2-1b5b-4a43-9b1b-67d77607407e tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:46.916039 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d2e6f1b2-1b5b-4a43-9b1b-67d77607407e tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:46.916464 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d2e6f1b2-1b5b-4a43-9b1b-67d77607407e tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:47.038511 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-df4038f3-2c5f-43b2-bcaa-5526ae9db248 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:47.040211 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-df4038f3-2c5f-43b2-bcaa-5526ae9db248 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] [instance: 3794302e-1657-4edd-9e15-a78592597d5b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:47.051406 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-d2e6f1b2-1b5b-4a43-9b1b-67d77607407e tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7493d38d24493b3298ac37592ecd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c8a1db00944c59950120c030ab47e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:47.062556 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-df4038f3-2c5f-43b2-bcaa-5526ae9db248 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:47.062556 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-df4038f3-2c5f-43b2-bcaa-5526ae9db248 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:47.062556 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-df4038f3-2c5f-43b2-bcaa-5526ae9db248 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:47.062556 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-df4038f3-2c5f-43b2-bcaa-5526ae9db248 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:47.063159 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-df4038f3-2c5f-43b2-bcaa-5526ae9db248 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:47.063159 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-df4038f3-2c5f-43b2-bcaa-5526ae9db248 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:47.063555 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-d2e6f1b2-1b5b-4a43-9b1b-67d77607407e tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] 10.222.0.48 "GET /compute/v2.1/servers/b2d65671-2e58-41ac-9aa1-245420900315" status: 200 len: 1514 microversion: 2.1 time: 0.159460 Aug 11 11:06:47.064561 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 215/432] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:46 2022] GET /compute/v2.1/servers/b2d65671-2e58-41ac-9aa1-245420900315 => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:47.204487 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-df4038f3-2c5f-43b2-bcaa-5526ae9db248 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfaf5a716c5b448f8e1274de2fad307c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233f1c55781b4099be6e250e664c4fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:47.207910 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:47.212267 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-df4038f3-2c5f-43b2-bcaa-5526ae9db248 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] 10.222.0.48 "GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b" status: 200 len: 1358 microversion: 2.1 time: 0.179872 Aug 11 11:06:47.212835 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 218/433] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:47 2022] GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:47.262194 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-eca5bab6-ceba-4cf3-8838-68e587a5c9dc tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:47.262879 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-eca5bab6-ceba-4cf3-8838-68e587a5c9dc tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:47.271849 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-eca5bab6-ceba-4cf3-8838-68e587a5c9dc tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:47.272377 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-eca5bab6-ceba-4cf3-8838-68e587a5c9dc tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:47.272849 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-eca5bab6-ceba-4cf3-8838-68e587a5c9dc tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:47.273613 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-eca5bab6-ceba-4cf3-8838-68e587a5c9dc tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:47.274136 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-eca5bab6-ceba-4cf3-8838-68e587a5c9dc tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:47.274650 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-eca5bab6-ceba-4cf3-8838-68e587a5c9dc tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:47.417296 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-eca5bab6-ceba-4cf3-8838-68e587a5c9dc tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:47.425628 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-eca5bab6-ceba-4cf3-8838-68e587a5c9dc tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:47.427398 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-eca5bab6-ceba-4cf3-8838-68e587a5c9dc tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:47.428632 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-eca5bab6-ceba-4cf3-8838-68e587a5c9dc tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1719 microversion: 2.20 time: 0.170502 Aug 11 11:06:47.429191 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 216/434] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:06:47 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1719 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:06:47.787945 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-52006895-58f8-484a-8157-bf621b6e0f94 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:47.788589 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-52006895-58f8-484a-8157-bf621b6e0f94 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] [instance: 0762660d-ef9c-4c5d-9f82-6d679b066641] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:47.796724 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-52006895-58f8-484a-8157-bf621b6e0f94 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:47.797231 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-52006895-58f8-484a-8157-bf621b6e0f94 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:47.797689 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-52006895-58f8-484a-8157-bf621b6e0f94 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:47.798417 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-52006895-58f8-484a-8157-bf621b6e0f94 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:47.798940 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-52006895-58f8-484a-8157-bf621b6e0f94 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:47.799398 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-52006895-58f8-484a-8157-bf621b6e0f94 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:47.946004 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-52006895-58f8-484a-8157-bf621b6e0f94 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c727b8f265774a4bb03d8425212e7540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83857835f34141f18a89c759631878f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:47.955301 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-52006895-58f8-484a-8157-bf621b6e0f94 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] 10.222.0.48 "GET /compute/v2.1/servers/0762660d-ef9c-4c5d-9f82-6d679b066641" status: 200 len: 1470 microversion: 2.1 time: 0.171936 Aug 11 11:06:47.956029 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 219/435] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:47 2022] GET /compute/v2.1/servers/0762660d-ef9c-4c5d-9f82-6d679b066641 => generated 1470 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:48.085017 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-4b480194-0408-4bcc-ad61-428a34c4ba21 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:48.085534 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-4b480194-0408-4bcc-ad61-428a34c4ba21 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] [instance: b2d65671-2e58-41ac-9aa1-245420900315] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:48.092853 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4b480194-0408-4bcc-ad61-428a34c4ba21 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:48.093342 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4b480194-0408-4bcc-ad61-428a34c4ba21 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:48.093768 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4b480194-0408-4bcc-ad61-428a34c4ba21 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:48.094453 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4b480194-0408-4bcc-ad61-428a34c4ba21 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:48.094898 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4b480194-0408-4bcc-ad61-428a34c4ba21 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:48.095314 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4b480194-0408-4bcc-ad61-428a34c4ba21 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:48.234543 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-bf6ff54e-280e-4c4a-9d10-9837a45c1ec8 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:48.236003 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-bf6ff54e-280e-4c4a-9d10-9837a45c1ec8 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] [instance: 3794302e-1657-4edd-9e15-a78592597d5b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:48.239043 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-4b480194-0408-4bcc-ad61-428a34c4ba21 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7493d38d24493b3298ac37592ecd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c8a1db00944c59950120c030ab47e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:48.243669 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bf6ff54e-280e-4c4a-9d10-9837a45c1ec8 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:48.244221 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bf6ff54e-280e-4c4a-9d10-9837a45c1ec8 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:48.244762 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bf6ff54e-280e-4c4a-9d10-9837a45c1ec8 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:48.245460 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bf6ff54e-280e-4c4a-9d10-9837a45c1ec8 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:48.246076 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bf6ff54e-280e-4c4a-9d10-9837a45c1ec8 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:48.246741 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bf6ff54e-280e-4c4a-9d10-9837a45c1ec8 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:48.248616 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-4b480194-0408-4bcc-ad61-428a34c4ba21 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] 10.222.0.48 "GET /compute/v2.1/servers/b2d65671-2e58-41ac-9aa1-245420900315" status: 200 len: 1514 microversion: 2.1 time: 0.167377 Aug 11 11:06:48.249286 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 217/436] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:48 2022] GET /compute/v2.1/servers/b2d65671-2e58-41ac-9aa1-245420900315 => generated 1514 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:48.386682 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-bf6ff54e-280e-4c4a-9d10-9837a45c1ec8 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfaf5a716c5b448f8e1274de2fad307c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233f1c55781b4099be6e250e664c4fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:48.394655 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-bf6ff54e-280e-4c4a-9d10-9837a45c1ec8 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] 10.222.0.48 "GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b" status: 200 len: 1358 microversion: 2.1 time: 0.165209 Aug 11 11:06:48.395219 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 220/437] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:48 2022] GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:06:48.452247 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-f19efec4-624f-4748-b141-b20efc2d8572 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:48.452967 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-f19efec4-624f-4748-b141-b20efc2d8572 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:48.460256 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f19efec4-624f-4748-b141-b20efc2d8572 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:48.460848 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f19efec4-624f-4748-b141-b20efc2d8572 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:48.461527 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f19efec4-624f-4748-b141-b20efc2d8572 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:48.462219 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f19efec4-624f-4748-b141-b20efc2d8572 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:48.462670 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f19efec4-624f-4748-b141-b20efc2d8572 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:48.463095 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f19efec4-624f-4748-b141-b20efc2d8572 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:48.596856 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-f19efec4-624f-4748-b141-b20efc2d8572 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:48.611068 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-f19efec4-624f-4748-b141-b20efc2d8572 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:48.612628 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-f19efec4-624f-4748-b141-b20efc2d8572 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:48.616942 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-f19efec4-624f-4748-b141-b20efc2d8572 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1722 microversion: 2.20 time: 0.166876 Aug 11 11:06:48.616942 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 218/438] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:06:48 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:06:48.637672 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-f51a161b-e6d5-4c6d-bc88-4187b4a6a5dc tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "86b39614-6b2a-4dfd-a40d-7afda8afcaa6"}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:06:48.640127 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-f51a161b-e6d5-4c6d-bc88-4187b4a6a5dc tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:48.646138 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f51a161b-e6d5-4c6d-bc88-4187b4a6a5dc tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:48.646611 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f51a161b-e6d5-4c6d-bc88-4187b4a6a5dc tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:48.647037 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f51a161b-e6d5-4c6d-bc88-4187b4a6a5dc tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:48.647709 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f51a161b-e6d5-4c6d-bc88-4187b4a6a5dc tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:48.648186 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f51a161b-e6d5-4c6d-bc88-4187b4a6a5dc tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:48.648603 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f51a161b-e6d5-4c6d-bc88-4187b4a6a5dc tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:48.978703 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-c6127691-71b9-46b7-9b9a-9325d155de5f tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:48.979306 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-c6127691-71b9-46b7-9b9a-9325d155de5f tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] [instance: 0762660d-ef9c-4c5d-9f82-6d679b066641] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:48.986036 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c6127691-71b9-46b7-9b9a-9325d155de5f tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:48.986520 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c6127691-71b9-46b7-9b9a-9325d155de5f tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:48.986951 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c6127691-71b9-46b7-9b9a-9325d155de5f tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:48.987634 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c6127691-71b9-46b7-9b9a-9325d155de5f tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:48.988109 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c6127691-71b9-46b7-9b9a-9325d155de5f tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:48.988717 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c6127691-71b9-46b7-9b9a-9325d155de5f tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:49.139741 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-c6127691-71b9-46b7-9b9a-9325d155de5f tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c727b8f265774a4bb03d8425212e7540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83857835f34141f18a89c759631878f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:49.148245 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-c6127691-71b9-46b7-9b9a-9325d155de5f tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] 10.222.0.48 "GET /compute/v2.1/servers/0762660d-ef9c-4c5d-9f82-6d679b066641" status: 200 len: 1470 microversion: 2.1 time: 0.173678 Aug 11 11:06:49.148830 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 219/439] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:48 2022] GET /compute/v2.1/servers/0762660d-ef9c-4c5d-9f82-6d679b066641 => generated 1470 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:06:49.272770 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-13a587dc-c6ec-4c57-9d77-da786b4cacb9 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:49.273594 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-13a587dc-c6ec-4c57-9d77-da786b4cacb9 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] [instance: b2d65671-2e58-41ac-9aa1-245420900315] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:49.281483 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-13a587dc-c6ec-4c57-9d77-da786b4cacb9 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:49.282121 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-13a587dc-c6ec-4c57-9d77-da786b4cacb9 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:49.282654 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-13a587dc-c6ec-4c57-9d77-da786b4cacb9 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:49.283495 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-13a587dc-c6ec-4c57-9d77-da786b4cacb9 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:49.284245 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-13a587dc-c6ec-4c57-9d77-da786b4cacb9 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:49.284730 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-13a587dc-c6ec-4c57-9d77-da786b4cacb9 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:49.575163 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-13a587dc-c6ec-4c57-9d77-da786b4cacb9 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7493d38d24493b3298ac37592ecd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c8a1db00944c59950120c030ab47e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:49.594416 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-13a587dc-c6ec-4c57-9d77-da786b4cacb9 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] 10.222.0.48 "GET /compute/v2.1/servers/b2d65671-2e58-41ac-9aa1-245420900315" status: 200 len: 1514 microversion: 2.1 time: 0.316849 Aug 11 11:06:49.605361 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 220/440] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:49 2022] GET /compute/v2.1/servers/b2d65671-2e58-41ac-9aa1-245420900315 => generated 1514 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:49.613617 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-b25a0caf-fdc4-4707-a0e2-73328e4e23ba tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:49.615119 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-b25a0caf-fdc4-4707-a0e2-73328e4e23ba tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] [instance: 3794302e-1657-4edd-9e15-a78592597d5b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:49.623699 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b25a0caf-fdc4-4707-a0e2-73328e4e23ba tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:49.624525 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b25a0caf-fdc4-4707-a0e2-73328e4e23ba tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:49.625639 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b25a0caf-fdc4-4707-a0e2-73328e4e23ba tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:49.626511 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b25a0caf-fdc4-4707-a0e2-73328e4e23ba tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:49.627111 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b25a0caf-fdc4-4707-a0e2-73328e4e23ba tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:49.627681 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b25a0caf-fdc4-4707-a0e2-73328e4e23ba tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:49.863517 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-b25a0caf-fdc4-4707-a0e2-73328e4e23ba tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfaf5a716c5b448f8e1274de2fad307c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233f1c55781b4099be6e250e664c4fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:49.871540 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-b25a0caf-fdc4-4707-a0e2-73328e4e23ba tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] 10.222.0.48 "GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b" status: 200 len: 1358 microversion: 2.1 time: 0.263145 Aug 11 11:06:49.872660 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 221/441] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:49 2022] GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b => generated 1358 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:49.929575 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-bf0be840-80b8-4493-86c2-4d889f2011ef req-5c9b64bf-aff3-4772-a598-f6dfbc72751d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2d65671-2e58-41ac-9aa1-245420900315", "name": "network-vif-deleted", "tag": "f9bf133d-cd7d-427c-affe-dd52652cff0c"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:06:49.943283 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-bf0be840-80b8-4493-86c2-4d889f2011ef req-5c9b64bf-aff3-4772-a598-f6dfbc72751d service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:49.944020 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-bf0be840-80b8-4493-86c2-4d889f2011ef req-5c9b64bf-aff3-4772-a598-f6dfbc72751d service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:49.944577 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-bf0be840-80b8-4493-86c2-4d889f2011ef req-5c9b64bf-aff3-4772-a598-f6dfbc72751d service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:49.958383 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-bf0be840-80b8-4493-86c2-4d889f2011ef req-5c9b64bf-aff3-4772-a598-f6dfbc72751d service nova] Creating event network-vif-deleted:f9bf133d-cd7d-427c-affe-dd52652cff0c for instance b2d65671-2e58-41ac-9aa1-245420900315 on hv-cinder-82002 Aug 11 11:06:49.963545 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-bf0be840-80b8-4493-86c2-4d889f2011ef req-5c9b64bf-aff3-4772-a598-f6dfbc72751d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046225 Aug 11 11:06:49.964389 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 222/442] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:06:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 11:06:50.012910 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-f0a1141d-f63b-43b8-9861-c9bb2ecd14b9 req-e6f67c56-d032-4db1-956b-76db5ac09926 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0762660d-ef9c-4c5d-9f82-6d679b066641", "name": "network-vif-deleted", "tag": "0b55ba06-1442-4212-8bed-52450c407f97"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:06:50.023941 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-f0a1141d-f63b-43b8-9861-c9bb2ecd14b9 req-e6f67c56-d032-4db1-956b-76db5ac09926 service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:50.024405 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-f0a1141d-f63b-43b8-9861-c9bb2ecd14b9 req-e6f67c56-d032-4db1-956b-76db5ac09926 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:50.024889 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-f0a1141d-f63b-43b8-9861-c9bb2ecd14b9 req-e6f67c56-d032-4db1-956b-76db5ac09926 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:50.038460 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-f0a1141d-f63b-43b8-9861-c9bb2ecd14b9 req-e6f67c56-d032-4db1-956b-76db5ac09926 service nova] Creating event network-vif-deleted:0b55ba06-1442-4212-8bed-52450c407f97 for instance 0762660d-ef9c-4c5d-9f82-6d679b066641 on hv-cinder-82002 Aug 11 11:06:50.043095 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-f51a161b-e6d5-4c6d-bc88-4187b4a6a5dc tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "POST /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.409449 Aug 11 11:06:50.047806 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 221/443] 10.222.0.48 () {62 vars in 1364 bytes} [Thu Aug 11 11:06:48 2022] POST /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc/os-volume_attachments => generated 188 bytes in 1411 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 11:06:50.048229 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-f0a1141d-f63b-43b8-9861-c9bb2ecd14b9 req-e6f67c56-d032-4db1-956b-76db5ac09926 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034492 Aug 11 11:06:50.049084 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 223/444] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:06:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 11:06:50.174806 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-542deeae-b35a-4a50-9840-eef69977bc24 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:50.175891 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-542deeae-b35a-4a50-9840-eef69977bc24 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] [instance: 0762660d-ef9c-4c5d-9f82-6d679b066641] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:50.184044 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-542deeae-b35a-4a50-9840-eef69977bc24 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:50.184823 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-542deeae-b35a-4a50-9840-eef69977bc24 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:50.185439 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-542deeae-b35a-4a50-9840-eef69977bc24 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:50.185992 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-a2e648d8-8ce6-4710-bb5f-2e8cd9f5baa9 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:06:50.186671 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-a2e648d8-8ce6-4710-bb5f-2e8cd9f5baa9 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:50.187167 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-542deeae-b35a-4a50-9840-eef69977bc24 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:50.193327 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-542deeae-b35a-4a50-9840-eef69977bc24 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:50.193488 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a2e648d8-8ce6-4710-bb5f-2e8cd9f5baa9 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:50.193756 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a2e648d8-8ce6-4710-bb5f-2e8cd9f5baa9 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:50.194191 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a2e648d8-8ce6-4710-bb5f-2e8cd9f5baa9 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:50.194942 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-542deeae-b35a-4a50-9840-eef69977bc24 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:50.195372 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a2e648d8-8ce6-4710-bb5f-2e8cd9f5baa9 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:50.196627 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a2e648d8-8ce6-4710-bb5f-2e8cd9f5baa9 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:50.197769 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a2e648d8-8ce6-4710-bb5f-2e8cd9f5baa9 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:50.259566 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-a2e648d8-8ce6-4710-bb5f-2e8cd9f5baa9 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121231) unshelve /opt/stack/nova/nova/compute/api.py:4544}} Aug 11 11:06:50.302539 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-542deeae-b35a-4a50-9840-eef69977bc24 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c727b8f265774a4bb03d8425212e7540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83857835f34141f18a89c759631878f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:50.310269 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-542deeae-b35a-4a50-9840-eef69977bc24 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] 10.222.0.48 "GET /compute/v2.1/servers/0762660d-ef9c-4c5d-9f82-6d679b066641" status: 200 len: 1428 microversion: 2.1 time: 0.140626 Aug 11 11:06:50.310838 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 222/445] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:50 2022] GET /compute/v2.1/servers/0762660d-ef9c-4c5d-9f82-6d679b066641 => generated 1428 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:50.618042 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-b676f8ee-a0fe-4e5e-9b4c-35e369f36c65 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:50.618651 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-b676f8ee-a0fe-4e5e-9b4c-35e369f36c65 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] [instance: b2d65671-2e58-41ac-9aa1-245420900315] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:50.625349 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b676f8ee-a0fe-4e5e-9b4c-35e369f36c65 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:50.625832 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b676f8ee-a0fe-4e5e-9b4c-35e369f36c65 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:50.626262 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b676f8ee-a0fe-4e5e-9b4c-35e369f36c65 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:50.626945 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b676f8ee-a0fe-4e5e-9b4c-35e369f36c65 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:50.627394 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b676f8ee-a0fe-4e5e-9b4c-35e369f36c65 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:50.627839 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b676f8ee-a0fe-4e5e-9b4c-35e369f36c65 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:50.698180 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-b676f8ee-a0fe-4e5e-9b4c-35e369f36c65 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7493d38d24493b3298ac37592ecd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c8a1db00944c59950120c030ab47e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:50.706970 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-b676f8ee-a0fe-4e5e-9b4c-35e369f36c65 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] 10.222.0.48 "GET /compute/v2.1/servers/b2d65671-2e58-41ac-9aa1-245420900315" status: 200 len: 1304 microversion: 2.1 time: 0.092884 Aug 11 11:06:50.707537 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 223/446] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:50 2022] GET /compute/v2.1/servers/b2d65671-2e58-41ac-9aa1-245420900315 => generated 1304 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:06:50.730530 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-a2e648d8-8ce6-4710-bb5f-2e8cd9f5baa9 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "POST /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc/action" status: 202 len: 0 microversion: 2.20 time: 0.549706 Aug 11 11:06:50.732776 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 224/447] 10.222.0.48 () {62 vars in 1319 bytes} [Thu Aug 11 11:06:50 2022] POST /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc/action => generated 0 bytes in 553 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 11 11:06:50.748186 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-af37c0e9-c1b3-4944-8aca-7765ca8a1e3b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:50.748186 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-af37c0e9-c1b3-4944-8aca-7765ca8a1e3b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:50.751113 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-af37c0e9-c1b3-4944-8aca-7765ca8a1e3b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:50.751361 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-af37c0e9-c1b3-4944-8aca-7765ca8a1e3b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:50.751811 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-af37c0e9-c1b3-4944-8aca-7765ca8a1e3b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:50.752530 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-af37c0e9-c1b3-4944-8aca-7765ca8a1e3b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:50.752987 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-af37c0e9-c1b3-4944-8aca-7765ca8a1e3b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:50.753404 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-af37c0e9-c1b3-4944-8aca-7765ca8a1e3b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:50.894347 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-1e5c94c3-dc88-4a5f-80a5-1788c51a10f7 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:50.895037 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-1e5c94c3-dc88-4a5f-80a5-1788c51a10f7 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] [instance: 3794302e-1657-4edd-9e15-a78592597d5b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:50.904171 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1e5c94c3-dc88-4a5f-80a5-1788c51a10f7 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:50.904171 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1e5c94c3-dc88-4a5f-80a5-1788c51a10f7 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:50.904512 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1e5c94c3-dc88-4a5f-80a5-1788c51a10f7 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:50.906247 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1e5c94c3-dc88-4a5f-80a5-1788c51a10f7 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:50.906822 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1e5c94c3-dc88-4a5f-80a5-1788c51a10f7 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:50.907324 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1e5c94c3-dc88-4a5f-80a5-1788c51a10f7 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:50.946400 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-af37c0e9-c1b3-4944-8aca-7765ca8a1e3b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:50.956919 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-af37c0e9-c1b3-4944-8aca-7765ca8a1e3b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:50.959938 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-af37c0e9-c1b3-4944-8aca-7765ca8a1e3b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:50.961364 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-af37c0e9-c1b3-4944-8aca-7765ca8a1e3b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1748 microversion: 2.20 time: 0.223186 Aug 11 11:06:50.962379 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 224/448] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:06:50 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1748 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:06:51.076841 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-1e5c94c3-dc88-4a5f-80a5-1788c51a10f7 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfaf5a716c5b448f8e1274de2fad307c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233f1c55781b4099be6e250e664c4fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:51.085431 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-1e5c94c3-dc88-4a5f-80a5-1788c51a10f7 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] 10.222.0.48 "GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b" status: 200 len: 1358 microversion: 2.1 time: 0.194958 Aug 11 11:06:51.096032 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 225/449] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:50 2022] GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b => generated 1358 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:06:51.331895 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-fbbf3327-103f-49dc-9661-32d0c42dd1a6 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:51.332566 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-fbbf3327-103f-49dc-9661-32d0c42dd1a6 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] [instance: 0762660d-ef9c-4c5d-9f82-6d679b066641] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:51.338780 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fbbf3327-103f-49dc-9661-32d0c42dd1a6 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:51.339258 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fbbf3327-103f-49dc-9661-32d0c42dd1a6 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:51.339709 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fbbf3327-103f-49dc-9661-32d0c42dd1a6 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:51.340959 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fbbf3327-103f-49dc-9661-32d0c42dd1a6 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:51.341445 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fbbf3327-103f-49dc-9661-32d0c42dd1a6 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:51.341866 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fbbf3327-103f-49dc-9661-32d0c42dd1a6 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:51.375653 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fbbf3327-103f-49dc-9661-32d0c42dd1a6 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:51.376162 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fbbf3327-103f-49dc-9661-32d0c42dd1a6 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:51.376588 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fbbf3327-103f-49dc-9661-32d0c42dd1a6 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:51.377041 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.objects.instance [None req-fbbf3327-103f-49dc-9661-32d0c42dd1a6 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lazy-loading 'fault' on Instance uuid 0762660d-ef9c-4c5d-9f82-6d679b066641 {{(pid=121232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 11:06:51.421168 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-fbbf3327-103f-49dc-9661-32d0c42dd1a6 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c727b8f265774a4bb03d8425212e7540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83857835f34141f18a89c759631878f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:51.429096 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-fbbf3327-103f-49dc-9661-32d0c42dd1a6 tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] 10.222.0.48 "GET /compute/v2.1/servers/0762660d-ef9c-4c5d-9f82-6d679b066641" status: 200 len: 1304 microversion: 2.1 time: 0.101128 Aug 11 11:06:51.429671 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 225/450] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:51 2022] GET /compute/v2.1/servers/0762660d-ef9c-4c5d-9f82-6d679b066641 => generated 1304 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:51.734942 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-a527c82e-3a7d-4d8b-889b-7077af1159c5 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:51.735636 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-a527c82e-3a7d-4d8b-889b-7077af1159c5 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] [instance: b2d65671-2e58-41ac-9aa1-245420900315] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:51.742932 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a527c82e-3a7d-4d8b-889b-7077af1159c5 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:51.744048 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a527c82e-3a7d-4d8b-889b-7077af1159c5 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:51.744490 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a527c82e-3a7d-4d8b-889b-7077af1159c5 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:51.745332 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a527c82e-3a7d-4d8b-889b-7077af1159c5 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:51.745796 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a527c82e-3a7d-4d8b-889b-7077af1159c5 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:51.746365 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a527c82e-3a7d-4d8b-889b-7077af1159c5 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:51.787019 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a527c82e-3a7d-4d8b-889b-7077af1159c5 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:51.787498 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a527c82e-3a7d-4d8b-889b-7077af1159c5 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:51.788089 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a527c82e-3a7d-4d8b-889b-7077af1159c5 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:51.788541 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.objects.instance [None req-a527c82e-3a7d-4d8b-889b-7077af1159c5 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lazy-loading 'fault' on Instance uuid b2d65671-2e58-41ac-9aa1-245420900315 {{(pid=121231) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 11:06:51.836500 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-a527c82e-3a7d-4d8b-889b-7077af1159c5 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7493d38d24493b3298ac37592ecd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c8a1db00944c59950120c030ab47e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:51.846556 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-a527c82e-3a7d-4d8b-889b-7077af1159c5 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] 10.222.0.48 "GET /compute/v2.1/servers/b2d65671-2e58-41ac-9aa1-245420900315" status: 200 len: 1309 microversion: 2.1 time: 0.115774 Aug 11 11:06:51.847459 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 226/451] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:51 2022] GET /compute/v2.1/servers/b2d65671-2e58-41ac-9aa1-245420900315 => generated 1309 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:51.986871 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-b1927d86-1027-4e55-93c8-79f7137eb073 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:51.987971 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-b1927d86-1027-4e55-93c8-79f7137eb073 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:51.994808 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b1927d86-1027-4e55-93c8-79f7137eb073 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:52.001079 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b1927d86-1027-4e55-93c8-79f7137eb073 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:52.001079 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b1927d86-1027-4e55-93c8-79f7137eb073 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:52.001079 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b1927d86-1027-4e55-93c8-79f7137eb073 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:52.001079 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b1927d86-1027-4e55-93c8-79f7137eb073 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:52.001989 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b1927d86-1027-4e55-93c8-79f7137eb073 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:52.112788 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-a23c45dc-5f3c-4356-916d-93e978c5aae2 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:52.372778 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-a23c45dc-5f3c-4356-916d-93e978c5aae2 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] [instance: 3794302e-1657-4edd-9e15-a78592597d5b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:52.372778 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a23c45dc-5f3c-4356-916d-93e978c5aae2 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:52.372778 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a23c45dc-5f3c-4356-916d-93e978c5aae2 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:52.372778 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a23c45dc-5f3c-4356-916d-93e978c5aae2 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:52.373140 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a23c45dc-5f3c-4356-916d-93e978c5aae2 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:52.373140 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a23c45dc-5f3c-4356-916d-93e978c5aae2 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:52.373140 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a23c45dc-5f3c-4356-916d-93e978c5aae2 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:52.373387 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-b1927d86-1027-4e55-93c8-79f7137eb073 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:52.373387 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-b1927d86-1027-4e55-93c8-79f7137eb073 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:52.373899 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-b1927d86-1027-4e55-93c8-79f7137eb073 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:52.373899 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-b1927d86-1027-4e55-93c8-79f7137eb073 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1748 microversion: 2.20 time: 0.171411 Aug 11 11:06:52.373899 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 226/452] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:06:51 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1748 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:06:52.374172 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-a23c45dc-5f3c-4356-916d-93e978c5aae2 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfaf5a716c5b448f8e1274de2fad307c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233f1c55781b4099be6e250e664c4fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:52.374172 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-a23c45dc-5f3c-4356-916d-93e978c5aae2 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] 10.222.0.48 "GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b" status: 200 len: 1547 microversion: 2.1 time: 0.162726 Aug 11 11:06:52.374172 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 227/453] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:52 2022] GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b => generated 1547 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:52.374449 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-8fe66a65-c76b-4bfd-b8ff-4711cb916ce6 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:52.374449 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-8fe66a65-c76b-4bfd-b8ff-4711cb916ce6 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] [instance: 3794302e-1657-4edd-9e15-a78592597d5b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:52.381674 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8fe66a65-c76b-4bfd-b8ff-4711cb916ce6 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:52.382152 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8fe66a65-c76b-4bfd-b8ff-4711cb916ce6 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:52.382583 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8fe66a65-c76b-4bfd-b8ff-4711cb916ce6 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:52.383260 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8fe66a65-c76b-4bfd-b8ff-4711cb916ce6 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:52.383704 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8fe66a65-c76b-4bfd-b8ff-4711cb916ce6 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:52.384149 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8fe66a65-c76b-4bfd-b8ff-4711cb916ce6 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:52.454295 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-10bde4b2-5ddb-4129-ae4f-a0ca80a312ae tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:52.456851 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-10bde4b2-5ddb-4129-ae4f-a0ca80a312ae tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] [instance: 0762660d-ef9c-4c5d-9f82-6d679b066641] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:52.464285 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-10bde4b2-5ddb-4129-ae4f-a0ca80a312ae tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:52.465126 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-10bde4b2-5ddb-4129-ae4f-a0ca80a312ae tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:52.466222 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-10bde4b2-5ddb-4129-ae4f-a0ca80a312ae tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:52.467183 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-10bde4b2-5ddb-4129-ae4f-a0ca80a312ae tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:52.468653 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-10bde4b2-5ddb-4129-ae4f-a0ca80a312ae tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:52.468653 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-10bde4b2-5ddb-4129-ae4f-a0ca80a312ae tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:52.503248 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-10bde4b2-5ddb-4129-ae4f-a0ca80a312ae tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:52.503736 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-10bde4b2-5ddb-4129-ae4f-a0ca80a312ae tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:52.504303 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-10bde4b2-5ddb-4129-ae4f-a0ca80a312ae tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:52.505351 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.objects.instance [None req-10bde4b2-5ddb-4129-ae4f-a0ca80a312ae tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lazy-loading 'fault' on Instance uuid 0762660d-ef9c-4c5d-9f82-6d679b066641 {{(pid=121231) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 11:06:52.559990 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-10bde4b2-5ddb-4129-ae4f-a0ca80a312ae tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c727b8f265774a4bb03d8425212e7540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83857835f34141f18a89c759631878f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:52.563420 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-8fe66a65-c76b-4bfd-b8ff-4711cb916ce6 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfaf5a716c5b448f8e1274de2fad307c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233f1c55781b4099be6e250e664c4fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:52.567910 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-10bde4b2-5ddb-4129-ae4f-a0ca80a312ae tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] 10.222.0.48 "GET /compute/v2.1/servers/0762660d-ef9c-4c5d-9f82-6d679b066641" status: 200 len: 1304 microversion: 2.1 time: 0.119714 Aug 11 11:06:52.568499 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 228/454] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:52 2022] GET /compute/v2.1/servers/0762660d-ef9c-4c5d-9f82-6d679b066641 => generated 1304 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:52.571589 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-8fe66a65-c76b-4bfd-b8ff-4711cb916ce6 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] 10.222.0.48 "GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b" status: 200 len: 1547 microversion: 2.1 time: 0.201764 Aug 11 11:06:52.572214 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 227/455] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:52 2022] GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b => generated 1547 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:52.592957 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-b7ac6f93-dd40-4230-ba7f-1975675536a9 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:52.597836 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-b7ac6f93-dd40-4230-ba7f-1975675536a9 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dfaf5a716c5b448f8e1274de2fad307c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233f1c55781b4099be6e250e664c4fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:52.598612 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-b7ac6f93-dd40-4230-ba7f-1975675536a9 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Searching by: {'deleted': False, 'project_id': '233f1c55781b4099be6e250e664c4fb9'} {{(pid=121231) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 11 11:06:52.606035 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b7ac6f93-dd40-4230-ba7f-1975675536a9 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:52.606516 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b7ac6f93-dd40-4230-ba7f-1975675536a9 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:52.606948 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b7ac6f93-dd40-4230-ba7f-1975675536a9 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:52.607662 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b7ac6f93-dd40-4230-ba7f-1975675536a9 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:52.608323 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b7ac6f93-dd40-4230-ba7f-1975675536a9 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:52.608745 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b7ac6f93-dd40-4230-ba7f-1975675536a9 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:52.701597 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.multi_cell_list [None req-b7ac6f93-dd40-4230-ba7f-1975675536a9 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121231) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 11 11:06:52.752913 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:52.799872 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-b7ac6f93-dd40-4230-ba7f-1975675536a9 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.211230 Aug 11 11:06:52.800460 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 229/456] 10.222.0.48 () {58 vars in 1125 bytes} [Thu Aug 11 11:06:52 2022] GET /compute/v2.1/servers => generated 343 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:06:52.812597 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-c11a2a6b-13d0-461e-81bc-c82c0ac5e453 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:52.813200 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-c11a2a6b-13d0-461e-81bc-c82c0ac5e453 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] [instance: 3794302e-1657-4edd-9e15-a78592597d5b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:52.819785 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c11a2a6b-13d0-461e-81bc-c82c0ac5e453 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:52.820386 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c11a2a6b-13d0-461e-81bc-c82c0ac5e453 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:52.820845 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c11a2a6b-13d0-461e-81bc-c82c0ac5e453 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:52.821598 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c11a2a6b-13d0-461e-81bc-c82c0ac5e453 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:52.822089 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c11a2a6b-13d0-461e-81bc-c82c0ac5e453 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:52.822576 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c11a2a6b-13d0-461e-81bc-c82c0ac5e453 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:52.868719 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-f2feee0d-986f-4098-b91b-4c717e0049d8 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:52.869332 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-f2feee0d-986f-4098-b91b-4c717e0049d8 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] [instance: b2d65671-2e58-41ac-9aa1-245420900315] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:52.875866 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f2feee0d-986f-4098-b91b-4c717e0049d8 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:52.876356 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f2feee0d-986f-4098-b91b-4c717e0049d8 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:52.876785 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f2feee0d-986f-4098-b91b-4c717e0049d8 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:52.877478 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f2feee0d-986f-4098-b91b-4c717e0049d8 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:52.877926 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f2feee0d-986f-4098-b91b-4c717e0049d8 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:52.878348 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f2feee0d-986f-4098-b91b-4c717e0049d8 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:52.917248 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f2feee0d-986f-4098-b91b-4c717e0049d8 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:52.917492 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f2feee0d-986f-4098-b91b-4c717e0049d8 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:52.917935 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f2feee0d-986f-4098-b91b-4c717e0049d8 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:52.918968 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.objects.instance [None req-f2feee0d-986f-4098-b91b-4c717e0049d8 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lazy-loading 'fault' on Instance uuid b2d65671-2e58-41ac-9aa1-245420900315 {{(pid=121231) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 11:06:52.990875 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-f2feee0d-986f-4098-b91b-4c717e0049d8 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7493d38d24493b3298ac37592ecd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c8a1db00944c59950120c030ab47e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:52.998441 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-f2feee0d-986f-4098-b91b-4c717e0049d8 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] 10.222.0.48 "GET /compute/v2.1/servers/b2d65671-2e58-41ac-9aa1-245420900315" status: 200 len: 1309 microversion: 2.1 time: 0.133579 Aug 11 11:06:52.999017 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 230/457] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:52 2022] GET /compute/v2.1/servers/b2d65671-2e58-41ac-9aa1-245420900315 => generated 1309 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:06:53.008579 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-c11a2a6b-13d0-461e-81bc-c82c0ac5e453 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfaf5a716c5b448f8e1274de2fad307c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233f1c55781b4099be6e250e664c4fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:53.022325 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-c11a2a6b-13d0-461e-81bc-c82c0ac5e453 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] 10.222.0.48 "GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b" status: 200 len: 1547 microversion: 2.1 time: 0.213978 Aug 11 11:06:53.025122 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 228/458] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:52 2022] GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b => generated 1547 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:06:53.376502 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-c01c8023-5375-4d92-a8c4-02d856d604ed tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:53.377286 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-c01c8023-5375-4d92-a8c4-02d856d604ed tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:53.384090 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c01c8023-5375-4d92-a8c4-02d856d604ed tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:53.384577 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c01c8023-5375-4d92-a8c4-02d856d604ed tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:53.385007 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c01c8023-5375-4d92-a8c4-02d856d604ed tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:53.385688 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c01c8023-5375-4d92-a8c4-02d856d604ed tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:53.386136 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c01c8023-5375-4d92-a8c4-02d856d604ed tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:53.386554 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c01c8023-5375-4d92-a8c4-02d856d604ed tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:53.528110 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-c01c8023-5375-4d92-a8c4-02d856d604ed tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:53.536474 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-c01c8023-5375-4d92-a8c4-02d856d604ed tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:53.538001 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-c01c8023-5375-4d92-a8c4-02d856d604ed tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:53.539188 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-c01c8023-5375-4d92-a8c4-02d856d604ed tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1748 microversion: 2.20 time: 0.168225 Aug 11 11:06:53.539975 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 231/459] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:06:53 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1748 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:06:53.592980 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-338ff162-17a8-4779-aed3-7671f296072e tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:53.593659 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-338ff162-17a8-4779-aed3-7671f296072e tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] [instance: 0762660d-ef9c-4c5d-9f82-6d679b066641] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:53.602398 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-338ff162-17a8-4779-aed3-7671f296072e tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:53.602876 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-338ff162-17a8-4779-aed3-7671f296072e tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:53.603514 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-338ff162-17a8-4779-aed3-7671f296072e tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:53.604603 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-338ff162-17a8-4779-aed3-7671f296072e tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:53.605434 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-338ff162-17a8-4779-aed3-7671f296072e tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:53.606040 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-338ff162-17a8-4779-aed3-7671f296072e tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:53.642397 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-338ff162-17a8-4779-aed3-7671f296072e tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:53.643306 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-338ff162-17a8-4779-aed3-7671f296072e tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:53.644030 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-338ff162-17a8-4779-aed3-7671f296072e tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:53.644777 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.objects.instance [None req-338ff162-17a8-4779-aed3-7671f296072e tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lazy-loading 'fault' on Instance uuid 0762660d-ef9c-4c5d-9f82-6d679b066641 {{(pid=121232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 11:06:53.693345 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-338ff162-17a8-4779-aed3-7671f296072e tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c727b8f265774a4bb03d8425212e7540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83857835f34141f18a89c759631878f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:53.701871 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-338ff162-17a8-4779-aed3-7671f296072e tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] 10.222.0.48 "GET /compute/v2.1/servers/0762660d-ef9c-4c5d-9f82-6d679b066641" status: 200 len: 1304 microversion: 2.1 time: 0.114770 Aug 11 11:06:53.702456 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 229/460] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:53 2022] GET /compute/v2.1/servers/0762660d-ef9c-4c5d-9f82-6d679b066641 => generated 1304 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:06:54.019153 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-4333de66-584b-4e13-8e0f-525d3d2a3526 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:54.019750 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-4333de66-584b-4e13-8e0f-525d3d2a3526 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] [instance: b2d65671-2e58-41ac-9aa1-245420900315] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:54.027235 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4333de66-584b-4e13-8e0f-525d3d2a3526 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:54.027732 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4333de66-584b-4e13-8e0f-525d3d2a3526 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:54.028269 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4333de66-584b-4e13-8e0f-525d3d2a3526 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:54.029067 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4333de66-584b-4e13-8e0f-525d3d2a3526 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:54.029526 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4333de66-584b-4e13-8e0f-525d3d2a3526 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:54.029949 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4333de66-584b-4e13-8e0f-525d3d2a3526 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:54.045032 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.wsgi [None req-4333de66-584b-4e13-8e0f-525d3d2a3526 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] HTTP exception thrown: Instance b2d65671-2e58-41ac-9aa1-245420900315 could not be found. Aug 11 11:06:54.048798 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-4333de66-584b-4e13-8e0f-525d3d2a3526 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Request method failure captured: Aug 11 11:06:54.048798 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: request: GET /compute/v2.1/servers/b2d65671-2e58-41ac-9aa1-245420900315 HTTP/1.1 Aug 11 11:06:54.048798 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Accept: application/json Aug 11 11:06:54.048798 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Accept-Encoding: identity Aug 11 11:06:54.048798 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Connection: close Aug 11 11:06:54.048798 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Content-Length: 0 Aug 11 11:06:54.048798 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Content-Type: application/json Aug 11 11:06:54.048798 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Host: 10.222.0.48 Aug 11 11:06:54.048798 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Openstack-System-Scope: None Aug 11 11:06:54.048798 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: User-Agent: python-urllib3/1.26.11 Aug 11 11:06:54.048798 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Auth-Token: gAAAAABi9OJfVrmRjtaHjNf1dWcTTs4AKzzYN5gibYpu0R_Wnx2VGbP-hyndIXQKfPsmuI0H4uFwyqzzg5IHH1XBjPn2gI2sgSMvug7BXuu1CX7egvgm2iZR7CNdIrA1GO9DjPmD7aN2Tw20UwpJCSvrynBj5epYRAjtcDqaTpY2DHbVBE0TFbc Aug 11 11:06:54.048798 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Domain-Id: None Aug 11 11:06:54.048798 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Domain-Name: None Aug 11 11:06:54.048798 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Identity-Status: Confirmed Aug 11 11:06:54.048798 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Is-Admin-Project: True Aug 11 11:06:54.048798 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Domain-Id: default Aug 11 11:06:54.048798 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Domain-Name: Default Aug 11 11:06:54.048798 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Id: 23c8a1db00944c59950120c030ab47e3 Aug 11 11:06:54.048798 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1987776856 Aug 11 11:06:54.048798 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Role: reader,member Aug 11 11:06:54.048798 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Roles: reader,member Aug 11 11:06:54.050946 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c8a1db00944c59950120c030ab47e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c8a1db00944c59950120c030ab47e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/23c8a1db00944c59950120c030ab47e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_23c8a1db00944c59950120c030ab47e3", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] Aug 11 11:06:54.050946 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant: tempest-VolumesSnapshotTestJSON-1987776856 Aug 11 11:06:54.050946 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant-Id: 23c8a1db00944c59950120c030ab47e3 Aug 11 11:06:54.050946 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1987776856 Aug 11 11:06:54.050946 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User: tempest-VolumesSnapshotTestJSON-1987776856-project Aug 11 11:06:54.050946 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Domain-Id: default Aug 11 11:06:54.050946 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Domain-Name: Default Aug 11 11:06:54.050946 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Id: f2e7493d38d24493b3298ac37592ecd4 Aug 11 11:06:54.050946 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Name: tempest-VolumesSnapshotTestJSON-1987776856-project Aug 11 11:06:54.050946 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: method: > Aug 11 11:06:54.050946 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: exception: Instance b2d65671-2e58-41ac-9aa1-245420900315 could not be found. Aug 11 11:06:54.050946 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: action_args: {'id': 'b2d65671-2e58-41ac-9aa1-245420900315'} Aug 11 11:06:54.052313 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 11:06:54.052313 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:06:54.052313 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 11:06:54.052313 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 11:06:54.052313 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 11:06:54.052313 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 11:06:54.052313 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 11:06:54.052313 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 11:06:54.052313 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 11:06:54.052313 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 11:06:54.052313 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2d65671-2e58-41ac-9aa1-245420900315 could not be found. Aug 11 11:06:54.052313 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:06:54.052313 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:06:54.052313 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:06:54.052313 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:06:54.052313 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:06:54.052313 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:06:54.052313 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 11:06:54.052313 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 11:06:54.052313 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 11:06:54.053556 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 11:06:54.053556 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 11:06:54.053556 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 11:06:54.053556 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 11:06:54.053556 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 11:06:54.053556 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 11:06:54.053556 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 11:06:54.053556 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2d65671-2e58-41ac-9aa1-245420900315 could not be found. Aug 11 11:06:54.053556 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:06:54.053556 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:06:54.053556 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:06:54.053556 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:06:54.053556 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:06:54.053556 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:06:54.053556 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 11:06:54.053556 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 11:06:54.053556 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2d65671-2e58-41ac-9aa1-245420900315 could not be found. Aug 11 11:06:54.053556 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:06:54.054653 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-4333de66-584b-4e13-8e0f-525d3d2a3526 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Returning 404 to user: Instance b2d65671-2e58-41ac-9aa1-245420900315 could not be found. {{(pid=121231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 11:06:54.054653 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-4333de66-584b-4e13-8e0f-525d3d2a3526 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] 10.222.0.48 "GET /compute/v2.1/servers/b2d65671-2e58-41ac-9aa1-245420900315" status: 404 len: 111 microversion: 2.1 time: 0.032817 Aug 11 11:06:54.054653 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 232/461] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:54 2022] GET /compute/v2.1/servers/b2d65671-2e58-41ac-9aa1-245420900315 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 11:06:54.567355 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-56fc3961-00ac-4545-942b-40a0a98818ab tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:54.567991 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-56fc3961-00ac-4545-942b-40a0a98818ab tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:54.575006 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-56fc3961-00ac-4545-942b-40a0a98818ab tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:54.575494 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-56fc3961-00ac-4545-942b-40a0a98818ab tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:54.576009 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-56fc3961-00ac-4545-942b-40a0a98818ab tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:54.576694 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-56fc3961-00ac-4545-942b-40a0a98818ab tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:54.577142 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-56fc3961-00ac-4545-942b-40a0a98818ab tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:54.577560 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-56fc3961-00ac-4545-942b-40a0a98818ab tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:54.715545 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-56fc3961-00ac-4545-942b-40a0a98818ab tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:54.722659 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-6d81f7cb-ab4b-49db-ad7f-24a6582f154f tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:54.723174 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-56fc3961-00ac-4545-942b-40a0a98818ab tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:54.723305 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-6d81f7cb-ab4b-49db-ad7f-24a6582f154f tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] [instance: 0762660d-ef9c-4c5d-9f82-6d679b066641] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:54.724765 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-56fc3961-00ac-4545-942b-40a0a98818ab tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:54.726039 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-56fc3961-00ac-4545-942b-40a0a98818ab tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1750 microversion: 2.20 time: 0.162669 Aug 11 11:06:54.726659 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 230/462] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:06:54 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1750 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:06:54.729594 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6d81f7cb-ab4b-49db-ad7f-24a6582f154f tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:54.730076 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6d81f7cb-ab4b-49db-ad7f-24a6582f154f tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:54.730512 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6d81f7cb-ab4b-49db-ad7f-24a6582f154f tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:54.731199 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6d81f7cb-ab4b-49db-ad7f-24a6582f154f tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:54.731650 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6d81f7cb-ab4b-49db-ad7f-24a6582f154f tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:54.732111 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6d81f7cb-ab4b-49db-ad7f-24a6582f154f tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:54.745819 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.wsgi [None req-6d81f7cb-ab4b-49db-ad7f-24a6582f154f tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] HTTP exception thrown: Instance 0762660d-ef9c-4c5d-9f82-6d679b066641 could not be found. Aug 11 11:06:54.750011 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-6d81f7cb-ab4b-49db-ad7f-24a6582f154f tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Request method failure captured: Aug 11 11:06:54.750011 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: request: GET /compute/v2.1/servers/0762660d-ef9c-4c5d-9f82-6d679b066641 HTTP/1.1 Aug 11 11:06:54.750011 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Accept: application/json Aug 11 11:06:54.750011 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Accept-Encoding: identity Aug 11 11:06:54.750011 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Connection: close Aug 11 11:06:54.750011 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Content-Length: 0 Aug 11 11:06:54.750011 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Content-Type: application/json Aug 11 11:06:54.750011 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Host: 10.222.0.48 Aug 11 11:06:54.750011 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Openstack-System-Scope: None Aug 11 11:06:54.750011 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: User-Agent: python-urllib3/1.26.11 Aug 11 11:06:54.750011 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Auth-Token: gAAAAABi9OKcXDHIqmMjEFmfSJkp6an1J1JxO92k_uZ-daFJ04tzpu7tOX6dPWvO4ALrHG8Atl0kVpilSdS8OZlFtUY9zRueNM2Nk7TtbRhkbIDP_OaPkJM28-B1zyxDHsxZdz2GM55ubaim1BCeP9u_Ff1oQ696Ei-FBuPE7H0hUOP-RwraNnI Aug 11 11:06:54.750011 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Domain-Id: None Aug 11 11:06:54.750011 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Domain-Name: None Aug 11 11:06:54.750011 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Identity-Status: Confirmed Aug 11 11:06:54.750011 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Is-Admin-Project: True Aug 11 11:06:54.750011 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Domain-Id: default Aug 11 11:06:54.750011 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Domain-Name: Default Aug 11 11:06:54.750011 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Id: 83857835f34141f18a89c759631878f6 Aug 11 11:06:54.750011 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Name: tempest-VolumesNegativeTest-679532839 Aug 11 11:06:54.750011 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Role: reader,member Aug 11 11:06:54.750011 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Roles: reader,member Aug 11 11:06:54.751630 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/83857835f34141f18a89c759631878f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/83857835f34141f18a89c759631878f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/83857835f34141f18a89c759631878f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_83857835f34141f18a89c759631878f6", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] Aug 11 11:06:54.751630 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant: tempest-VolumesNegativeTest-679532839 Aug 11 11:06:54.751630 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant-Id: 83857835f34141f18a89c759631878f6 Aug 11 11:06:54.751630 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant-Name: tempest-VolumesNegativeTest-679532839 Aug 11 11:06:54.751630 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User: tempest-VolumesNegativeTest-679532839-project Aug 11 11:06:54.751630 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Domain-Id: default Aug 11 11:06:54.751630 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Domain-Name: Default Aug 11 11:06:54.751630 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Id: c727b8f265774a4bb03d8425212e7540 Aug 11 11:06:54.751630 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Name: tempest-VolumesNegativeTest-679532839-project Aug 11 11:06:54.751630 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: method: > Aug 11 11:06:54.751630 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: exception: Instance 0762660d-ef9c-4c5d-9f82-6d679b066641 could not be found. Aug 11 11:06:54.751630 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: action_args: {'id': '0762660d-ef9c-4c5d-9f82-6d679b066641'} Aug 11 11:06:54.752628 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 11:06:54.752628 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:06:54.752628 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 11:06:54.752628 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 11:06:54.752628 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 11:06:54.752628 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 11:06:54.752628 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 11:06:54.752628 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 11:06:54.752628 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 11:06:54.752628 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 11:06:54.752628 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0762660d-ef9c-4c5d-9f82-6d679b066641 could not be found. Aug 11 11:06:54.752628 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:06:54.752628 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:06:54.752628 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:06:54.752628 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:06:54.752628 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:06:54.752628 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:06:54.752628 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 11:06:54.752628 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 11:06:54.752628 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 11:06:54.754176 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 11:06:54.754176 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 11:06:54.754176 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 11:06:54.754176 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 11:06:54.754176 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 11:06:54.754176 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 11:06:54.754176 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 11:06:54.754176 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0762660d-ef9c-4c5d-9f82-6d679b066641 could not be found. Aug 11 11:06:54.754176 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:06:54.754176 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:06:54.754176 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:06:54.754176 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:06:54.754176 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:06:54.754176 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:06:54.754176 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 11:06:54.754176 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 11:06:54.754176 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0762660d-ef9c-4c5d-9f82-6d679b066641 could not be found. Aug 11 11:06:54.754176 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:06:54.755458 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-6d81f7cb-ab4b-49db-ad7f-24a6582f154f tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] Returning 404 to user: Instance 0762660d-ef9c-4c5d-9f82-6d679b066641 could not be found. {{(pid=121231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 11:06:54.755458 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-6d81f7cb-ab4b-49db-ad7f-24a6582f154f tempest-VolumesNegativeTest-679532839 tempest-VolumesNegativeTest-679532839-project] 10.222.0.48 "GET /compute/v2.1/servers/0762660d-ef9c-4c5d-9f82-6d679b066641" status: 404 len: 111 microversion: 2.1 time: 0.030172 Aug 11 11:06:54.755458 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 233/463] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:06:54 2022] GET /compute/v2.1/servers/0762660d-ef9c-4c5d-9f82-6d679b066641 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 11:06:55.355121 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-8a7f5ea1-61fa-498e-9963-d210a868b49d tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "edef24ce-7270-4843-a839-29f9cc7038fe"}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:06:55.358032 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-8a7f5ea1-61fa-498e-9963-d210a868b49d tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] [instance: 3794302e-1657-4edd-9e15-a78592597d5b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:55.364097 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8a7f5ea1-61fa-498e-9963-d210a868b49d tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:55.364572 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8a7f5ea1-61fa-498e-9963-d210a868b49d tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:55.364999 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8a7f5ea1-61fa-498e-9963-d210a868b49d tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:55.365679 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8a7f5ea1-61fa-498e-9963-d210a868b49d tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:55.366123 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8a7f5ea1-61fa-498e-9963-d210a868b49d tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:55.366589 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8a7f5ea1-61fa-498e-9963-d210a868b49d tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:55.757341 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-b15ea36b-b975-4194-83df-c27157c092ca tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:55.760608 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-b15ea36b-b975-4194-83df-c27157c092ca tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:55.764510 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b15ea36b-b975-4194-83df-c27157c092ca tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:55.764988 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b15ea36b-b975-4194-83df-c27157c092ca tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:55.765443 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b15ea36b-b975-4194-83df-c27157c092ca tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:55.766125 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b15ea36b-b975-4194-83df-c27157c092ca tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:55.766575 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b15ea36b-b975-4194-83df-c27157c092ca tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:55.766995 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b15ea36b-b975-4194-83df-c27157c092ca tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:55.900855 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-b15ea36b-b975-4194-83df-c27157c092ca tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:55.910124 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-b15ea36b-b975-4194-83df-c27157c092ca tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:55.911628 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-b15ea36b-b975-4194-83df-c27157c092ca tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:55.912808 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-b15ea36b-b975-4194-83df-c27157c092ca tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1750 microversion: 2.20 time: 0.159339 Aug 11 11:06:55.913366 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 234/464] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:06:55 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1750 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 11:06:56.941775 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-8076ab8e-7db7-4777-9bd4-fce27a376ddf tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:56.943104 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-8076ab8e-7db7-4777-9bd4-fce27a376ddf tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:56.951858 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8076ab8e-7db7-4777-9bd4-fce27a376ddf tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:56.952400 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8076ab8e-7db7-4777-9bd4-fce27a376ddf tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:56.952838 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8076ab8e-7db7-4777-9bd4-fce27a376ddf tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:56.953545 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8076ab8e-7db7-4777-9bd4-fce27a376ddf tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:56.953993 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8076ab8e-7db7-4777-9bd4-fce27a376ddf tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:56.954494 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8076ab8e-7db7-4777-9bd4-fce27a376ddf tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:57.112870 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-8076ab8e-7db7-4777-9bd4-fce27a376ddf tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:57.123219 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-8076ab8e-7db7-4777-9bd4-fce27a376ddf tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:57.124797 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-8076ab8e-7db7-4777-9bd4-fce27a376ddf tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:57.126454 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-8076ab8e-7db7-4777-9bd4-fce27a376ddf tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1750 microversion: 2.20 time: 0.190396 Aug 11 11:06:57.127802 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 235/465] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:06:56 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1750 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 11:06:58.149667 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-a6c94b57-c0b1-48f2-9d65-527440664b8b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:58.150355 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-a6c94b57-c0b1-48f2-9d65-527440664b8b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:58.156825 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a6c94b57-c0b1-48f2-9d65-527440664b8b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:58.157315 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a6c94b57-c0b1-48f2-9d65-527440664b8b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:58.157750 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a6c94b57-c0b1-48f2-9d65-527440664b8b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:58.158449 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a6c94b57-c0b1-48f2-9d65-527440664b8b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:58.158904 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a6c94b57-c0b1-48f2-9d65-527440664b8b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:58.159331 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a6c94b57-c0b1-48f2-9d65-527440664b8b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:58.287486 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-a6c94b57-c0b1-48f2-9d65-527440664b8b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:58.296438 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-a6c94b57-c0b1-48f2-9d65-527440664b8b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:58.297926 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-a6c94b57-c0b1-48f2-9d65-527440664b8b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:58.299065 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-a6c94b57-c0b1-48f2-9d65-527440664b8b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1750 microversion: 2.20 time: 0.153500 Aug 11 11:06:58.299620 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 236/466] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:06:58 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1750 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 11:06:58.386699 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:06:59.222808 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-8a7f5ea1-61fa-498e-9963-d210a868b49d tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] 10.222.0.48 "POST /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.871422 Aug 11 11:06:59.223486 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 231/467] 10.222.0.48 () {60 vars in 1323 bytes} [Thu Aug 11 11:06:55 2022] POST /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b/os-volume_attachments => generated 194 bytes in 3873 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 11:06:59.321956 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-20163861-9213-4e1f-8cc6-1b586d30e442 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:06:59.322583 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-20163861-9213-4e1f-8cc6-1b586d30e442 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:06:59.333033 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-20163861-9213-4e1f-8cc6-1b586d30e442 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:59.333033 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-20163861-9213-4e1f-8cc6-1b586d30e442 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:59.333355 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-20163861-9213-4e1f-8cc6-1b586d30e442 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:59.333867 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-20163861-9213-4e1f-8cc6-1b586d30e442 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:06:59.334375 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-20163861-9213-4e1f-8cc6-1b586d30e442 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:06:59.334803 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-20163861-9213-4e1f-8cc6-1b586d30e442 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:06:59.515178 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-20163861-9213-4e1f-8cc6-1b586d30e442 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:59.524184 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-20163861-9213-4e1f-8cc6-1b586d30e442 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:59.525695 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-20163861-9213-4e1f-8cc6-1b586d30e442 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:06:59.526851 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-20163861-9213-4e1f-8cc6-1b586d30e442 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1750 microversion: 2.20 time: 0.208922 Aug 11 11:06:59.528156 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 237/468] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:06:59 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1750 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:07:00.555097 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-9ed95d75-f693-4cbf-892b-c39a547571a1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:00.555919 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-9ed95d75-f693-4cbf-892b-c39a547571a1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:00.563023 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9ed95d75-f693-4cbf-892b-c39a547571a1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:00.563790 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9ed95d75-f693-4cbf-892b-c39a547571a1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:00.564589 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9ed95d75-f693-4cbf-892b-c39a547571a1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:00.565580 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9ed95d75-f693-4cbf-892b-c39a547571a1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:00.566100 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9ed95d75-f693-4cbf-892b-c39a547571a1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:00.566589 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9ed95d75-f693-4cbf-892b-c39a547571a1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:00.734966 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-9ed95d75-f693-4cbf-892b-c39a547571a1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:00.745464 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-9ed95d75-f693-4cbf-892b-c39a547571a1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:00.747005 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-9ed95d75-f693-4cbf-892b-c39a547571a1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:00.748291 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-9ed95d75-f693-4cbf-892b-c39a547571a1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1806 microversion: 2.20 time: 0.199005 Aug 11 11:07:00.754582 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 232/469] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:07:00 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1806 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:07:01.776983 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-a325a049-f57f-4d4e-a1cb-c43b04e3cf97 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:01.777588 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-a325a049-f57f-4d4e-a1cb-c43b04e3cf97 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:01.784153 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a325a049-f57f-4d4e-a1cb-c43b04e3cf97 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:01.784678 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a325a049-f57f-4d4e-a1cb-c43b04e3cf97 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:01.785302 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a325a049-f57f-4d4e-a1cb-c43b04e3cf97 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:01.786260 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a325a049-f57f-4d4e-a1cb-c43b04e3cf97 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:01.786915 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a325a049-f57f-4d4e-a1cb-c43b04e3cf97 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:01.787617 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a325a049-f57f-4d4e-a1cb-c43b04e3cf97 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:01.932923 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-a325a049-f57f-4d4e-a1cb-c43b04e3cf97 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:01.942148 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-a325a049-f57f-4d4e-a1cb-c43b04e3cf97 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:01.944354 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-a325a049-f57f-4d4e-a1cb-c43b04e3cf97 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:01.945652 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-a325a049-f57f-4d4e-a1cb-c43b04e3cf97 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1806 microversion: 2.20 time: 0.172549 Aug 11 11:07:01.948388 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 238/470] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:07:01 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1806 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:07:02.969242 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-976c4f9c-76ab-4553-9c9a-4ec3a3f905f8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:02.969831 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-976c4f9c-76ab-4553-9c9a-4ec3a3f905f8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:02.976592 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-976c4f9c-76ab-4553-9c9a-4ec3a3f905f8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:02.977073 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-976c4f9c-76ab-4553-9c9a-4ec3a3f905f8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:02.977502 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-976c4f9c-76ab-4553-9c9a-4ec3a3f905f8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:02.978197 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-976c4f9c-76ab-4553-9c9a-4ec3a3f905f8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:02.978646 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-976c4f9c-76ab-4553-9c9a-4ec3a3f905f8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:02.979073 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-976c4f9c-76ab-4553-9c9a-4ec3a3f905f8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:03.117068 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-976c4f9c-76ab-4553-9c9a-4ec3a3f905f8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:03.126192 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-976c4f9c-76ab-4553-9c9a-4ec3a3f905f8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:03.127747 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-976c4f9c-76ab-4553-9c9a-4ec3a3f905f8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:03.129001 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-976c4f9c-76ab-4553-9c9a-4ec3a3f905f8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1806 microversion: 2.20 time: 0.163630 Aug 11 11:07:03.140036 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 233/471] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:07:02 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1806 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:07:04.152967 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-a9f5b76f-b16b-4c35-ae38-19a83b0b856d tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:04.153577 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-a9f5b76f-b16b-4c35-ae38-19a83b0b856d tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:04.155485 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell0:SELECT=2 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:07:04.160756 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a9f5b76f-b16b-4c35-ae38-19a83b0b856d tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:04.166435 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a9f5b76f-b16b-4c35-ae38-19a83b0b856d tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:04.166435 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a9f5b76f-b16b-4c35-ae38-19a83b0b856d tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:04.166435 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a9f5b76f-b16b-4c35-ae38-19a83b0b856d tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:04.166435 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a9f5b76f-b16b-4c35-ae38-19a83b0b856d tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:04.166797 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a9f5b76f-b16b-4c35-ae38-19a83b0b856d tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:04.291679 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-a9f5b76f-b16b-4c35-ae38-19a83b0b856d tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:04.300641 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-a9f5b76f-b16b-4c35-ae38-19a83b0b856d tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:04.302400 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-a9f5b76f-b16b-4c35-ae38-19a83b0b856d tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:04.303548 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-a9f5b76f-b16b-4c35-ae38-19a83b0b856d tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1806 microversion: 2.20 time: 0.154424 Aug 11 11:07:04.304142 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 239/472] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:07:04 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1806 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:07:05.229409 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-7a7c8a18-c090-4607-9eb9-e5caaf606ca8 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1622016103", "imageRef": "05993162-aafd-4f1d-b781-ec09593713e5", "flavorRef": "452", "networks": [{"uuid": "524e9a03-a779-4c8d-b440-eee39baf1b44"}]}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:07:05.290843 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.network.neutron [None req-7a7c8a18-c090-4607-9eb9-e5caaf606ca8 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] validate_networks() for [('524e9a03-a779-4c8d-b440-eee39baf1b44', None, None, None, None, None)] {{(pid=121232) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 11 11:07:05.336115 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-265adeb3-5de2-4a35-83f0-b7d9b8a1a951 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:05.336793 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-265adeb3-5de2-4a35-83f0-b7d9b8a1a951 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:05.345505 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-265adeb3-5de2-4a35-83f0-b7d9b8a1a951 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:05.346309 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-265adeb3-5de2-4a35-83f0-b7d9b8a1a951 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:05.347042 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-265adeb3-5de2-4a35-83f0-b7d9b8a1a951 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:05.348000 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-265adeb3-5de2-4a35-83f0-b7d9b8a1a951 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:05.348713 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-265adeb3-5de2-4a35-83f0-b7d9b8a1a951 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:05.349613 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-265adeb3-5de2-4a35-83f0-b7d9b8a1a951 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:05.580395 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-265adeb3-5de2-4a35-83f0-b7d9b8a1a951 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:05.594943 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-265adeb3-5de2-4a35-83f0-b7d9b8a1a951 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:05.599340 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-265adeb3-5de2-4a35-83f0-b7d9b8a1a951 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:05.606544 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-265adeb3-5de2-4a35-83f0-b7d9b8a1a951 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1806 microversion: 2.20 time: 0.275847 Aug 11 11:07:05.611736 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 240/473] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:07:05 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1806 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:07:05.814369 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-7a7c8a18-c090-4607-9eb9-e5caaf606ca8 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Flavor limits 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 11 11:07:05.815083 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-7a7c8a18-c090-4607-9eb9-e5caaf606ca8 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Image limits 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 11 11:07:05.815829 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-7a7c8a18-c090-4607-9eb9-e5caaf606ca8 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Flavor pref 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 11 11:07:05.816340 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-7a7c8a18-c090-4607-9eb9-e5caaf606ca8 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Image pref 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 11 11:07:05.816840 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-7a7c8a18-c090-4607-9eb9-e5caaf606ca8 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 11 11:07:05.836949 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7a7c8a18-c090-4607-9eb9-e5caaf606ca8 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:05.837697 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7a7c8a18-c090-4607-9eb9-e5caaf606ca8 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:05.846416 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7a7c8a18-c090-4607-9eb9-e5caaf606ca8 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:05.846416 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7a7c8a18-c090-4607-9eb9-e5caaf606ca8 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:05.846416 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7a7c8a18-c090-4607-9eb9-e5caaf606ca8 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:05.846416 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7a7c8a18-c090-4607-9eb9-e5caaf606ca8 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:05.858787 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-7a7c8a18-c090-4607-9eb9-e5caaf606ca8 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Getting quotas for project 23c8a1db00944c59950120c030ab47e3. Resources: {'ram', 'cores', 'instances'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 11:07:05.863886 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-7a7c8a18-c090-4607-9eb9-e5caaf606ca8 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Getting quotas for user f2e7493d38d24493b3298ac37592ecd4 and project 23c8a1db00944c59950120c030ab47e3. Resources: {'ram', 'cores', 'instances'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 11:07:05.877679 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-7a7c8a18-c090-4607-9eb9-e5caaf606ca8 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Going to run 1 instances... {{(pid=121232) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 11 11:07:05.880562 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-7a7c8a18-c090-4607-9eb9-e5caaf606ca8 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] [instance: ff5a8410-e497-415f-be25-4a20e3345698] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='05993162-aafd-4f1d-b781-ec09593713e5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121232) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 11 11:07:06.028467 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-7a7c8a18-c090-4607-9eb9-e5caaf606ca8 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.803892 Aug 11 11:07:06.030377 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 234/474] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Aug 11 11:07:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 807 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 11 11:07:06.043107 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-99243055-d98e-46cb-b806-9c2d81f43639 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:06.044097 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-99243055-d98e-46cb-b806-9c2d81f43639 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] [instance: ff5a8410-e497-415f-be25-4a20e3345698] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:06.103105 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-99243055-d98e-46cb-b806-9c2d81f43639 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7493d38d24493b3298ac37592ecd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c8a1db00944c59950120c030ab47e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:06.120893 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-99243055-d98e-46cb-b806-9c2d81f43639 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] 10.222.0.48 "GET /compute/v2.1/servers/ff5a8410-e497-415f-be25-4a20e3345698" status: 200 len: 1219 microversion: 2.1 time: 0.082122 Aug 11 11:07:06.122018 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 241/475] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:07:06 2022] GET /compute/v2.1/servers/ff5a8410-e497-415f-be25-4a20e3345698 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:07:06.503901 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 11:07:06.504667 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Thu Aug 11 11:07:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 11 11:07:06.630959 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-129b7f3b-bf2b-4941-8d97-b0e191439967 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:06.632065 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-129b7f3b-bf2b-4941-8d97-b0e191439967 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:06.643167 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-129b7f3b-bf2b-4941-8d97-b0e191439967 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:06.644432 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-129b7f3b-bf2b-4941-8d97-b0e191439967 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:06.644878 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-129b7f3b-bf2b-4941-8d97-b0e191439967 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:06.645585 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-129b7f3b-bf2b-4941-8d97-b0e191439967 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:06.646045 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-129b7f3b-bf2b-4941-8d97-b0e191439967 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:06.646487 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-129b7f3b-bf2b-4941-8d97-b0e191439967 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:06.834041 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-129b7f3b-bf2b-4941-8d97-b0e191439967 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:06.859434 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-129b7f3b-bf2b-4941-8d97-b0e191439967 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:06.863879 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-129b7f3b-bf2b-4941-8d97-b0e191439967 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:06.874722 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-129b7f3b-bf2b-4941-8d97-b0e191439967 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1806 microversion: 2.20 time: 0.238351 Aug 11 11:07:06.874722 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 235/476] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:07:06 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1806 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:07:07.149768 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-0daabbcb-81c8-4e7e-9dbc-2977f37220ab tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:07.150396 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-0daabbcb-81c8-4e7e-9dbc-2977f37220ab tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] [instance: ff5a8410-e497-415f-be25-4a20e3345698] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:07.157033 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0daabbcb-81c8-4e7e-9dbc-2977f37220ab tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:07.157456 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0daabbcb-81c8-4e7e-9dbc-2977f37220ab tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:07.158248 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0daabbcb-81c8-4e7e-9dbc-2977f37220ab tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:07.158944 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0daabbcb-81c8-4e7e-9dbc-2977f37220ab tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:07.159395 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0daabbcb-81c8-4e7e-9dbc-2977f37220ab tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:07.159833 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0daabbcb-81c8-4e7e-9dbc-2977f37220ab tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:07.228009 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-0daabbcb-81c8-4e7e-9dbc-2977f37220ab tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7493d38d24493b3298ac37592ecd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c8a1db00944c59950120c030ab47e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:07.235909 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-0daabbcb-81c8-4e7e-9dbc-2977f37220ab tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] 10.222.0.48 "GET /compute/v2.1/servers/ff5a8410-e497-415f-be25-4a20e3345698" status: 200 len: 1223 microversion: 2.1 time: 0.090107 Aug 11 11:07:07.236490 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 242/477] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:07:07 2022] GET /compute/v2.1/servers/ff5a8410-e497-415f-be25-4a20e3345698 => generated 1223 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:07:07.888239 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-ed84055b-fb5c-421e-bb48-46653408cc8f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:07.888796 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-ed84055b-fb5c-421e-bb48-46653408cc8f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:07.895521 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ed84055b-fb5c-421e-bb48-46653408cc8f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:07.896028 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ed84055b-fb5c-421e-bb48-46653408cc8f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:07.896455 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ed84055b-fb5c-421e-bb48-46653408cc8f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:07.897431 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ed84055b-fb5c-421e-bb48-46653408cc8f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:07.897882 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ed84055b-fb5c-421e-bb48-46653408cc8f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:07.898299 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ed84055b-fb5c-421e-bb48-46653408cc8f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:08.040677 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-ed84055b-fb5c-421e-bb48-46653408cc8f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:08.048091 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-ed84055b-fb5c-421e-bb48-46653408cc8f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:08.049615 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-ed84055b-fb5c-421e-bb48-46653408cc8f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:08.051042 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-ed84055b-fb5c-421e-bb48-46653408cc8f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1806 microversion: 2.20 time: 0.166526 Aug 11 11:07:08.051611 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 236/478] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:07:07 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1806 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:07:08.092998 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-a27ba746-c5ce-449e-8544-698e569a67bb tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ee369e49-b9bc-4046-b528-2b78a44b8f4e"}} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:07:08.095574 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-a27ba746-c5ce-449e-8544-698e569a67bb tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 481c1d02-4070-4d58-8be2-438cd1a68eb5] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:08.101527 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a27ba746-c5ce-449e-8544-698e569a67bb tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:08.102017 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a27ba746-c5ce-449e-8544-698e569a67bb tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:08.102456 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a27ba746-c5ce-449e-8544-698e569a67bb tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:08.103142 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a27ba746-c5ce-449e-8544-698e569a67bb tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:08.103597 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a27ba746-c5ce-449e-8544-698e569a67bb tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:08.104049 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a27ba746-c5ce-449e-8544-698e569a67bb tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:08.257172 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-b840c260-bf85-48e3-bd70-f6a6e762b6e0 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:08.257805 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-b840c260-bf85-48e3-bd70-f6a6e762b6e0 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] [instance: ff5a8410-e497-415f-be25-4a20e3345698] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:08.264469 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b840c260-bf85-48e3-bd70-f6a6e762b6e0 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:08.264947 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b840c260-bf85-48e3-bd70-f6a6e762b6e0 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:08.265377 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b840c260-bf85-48e3-bd70-f6a6e762b6e0 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:08.266056 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b840c260-bf85-48e3-bd70-f6a6e762b6e0 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:08.266501 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b840c260-bf85-48e3-bd70-f6a6e762b6e0 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:08.266970 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b840c260-bf85-48e3-bd70-f6a6e762b6e0 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:08.332407 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-b840c260-bf85-48e3-bd70-f6a6e762b6e0 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7493d38d24493b3298ac37592ecd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c8a1db00944c59950120c030ab47e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:08.340710 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-b840c260-bf85-48e3-bd70-f6a6e762b6e0 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] 10.222.0.48 "GET /compute/v2.1/servers/ff5a8410-e497-415f-be25-4a20e3345698" status: 200 len: 1223 microversion: 2.1 time: 0.087384 Aug 11 11:07:08.341470 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 237/479] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:07:08 2022] GET /compute/v2.1/servers/ff5a8410-e497-415f-be25-4a20e3345698 => generated 1223 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:07:09.075453 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-5ac4ab5e-bcdf-441e-aa39-04ad8e4a28fa tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:09.076292 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-5ac4ab5e-bcdf-441e-aa39-04ad8e4a28fa tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:09.083672 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5ac4ab5e-bcdf-441e-aa39-04ad8e4a28fa tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:09.084484 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5ac4ab5e-bcdf-441e-aa39-04ad8e4a28fa tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:09.085010 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5ac4ab5e-bcdf-441e-aa39-04ad8e4a28fa tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:09.085893 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5ac4ab5e-bcdf-441e-aa39-04ad8e4a28fa tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:09.086349 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5ac4ab5e-bcdf-441e-aa39-04ad8e4a28fa tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:09.086824 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5ac4ab5e-bcdf-441e-aa39-04ad8e4a28fa tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:09.243876 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-5ac4ab5e-bcdf-441e-aa39-04ad8e4a28fa tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:09.252822 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-5ac4ab5e-bcdf-441e-aa39-04ad8e4a28fa tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:09.254331 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-5ac4ab5e-bcdf-441e-aa39-04ad8e4a28fa tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:09.255492 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-5ac4ab5e-bcdf-441e-aa39-04ad8e4a28fa tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1806 microversion: 2.20 time: 0.184531 Aug 11 11:07:09.256281 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 238/480] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:07:09 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1806 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 11:07:09.361788 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-682eee95-106d-4e41-a462-49a67f941ea2 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:09.362565 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-682eee95-106d-4e41-a462-49a67f941ea2 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] [instance: ff5a8410-e497-415f-be25-4a20e3345698] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:09.369422 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-682eee95-106d-4e41-a462-49a67f941ea2 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:09.370070 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-682eee95-106d-4e41-a462-49a67f941ea2 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:09.370604 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-682eee95-106d-4e41-a462-49a67f941ea2 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:09.371450 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-682eee95-106d-4e41-a462-49a67f941ea2 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:09.372043 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-682eee95-106d-4e41-a462-49a67f941ea2 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:09.372568 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-682eee95-106d-4e41-a462-49a67f941ea2 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:09.437334 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-682eee95-106d-4e41-a462-49a67f941ea2 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7493d38d24493b3298ac37592ecd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c8a1db00944c59950120c030ab47e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:09.444988 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-682eee95-106d-4e41-a462-49a67f941ea2 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] 10.222.0.48 "GET /compute/v2.1/servers/ff5a8410-e497-415f-be25-4a20e3345698" status: 200 len: 1223 microversion: 2.1 time: 0.087220 Aug 11 11:07:09.445557 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 239/481] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:07:09 2022] GET /compute/v2.1/servers/ff5a8410-e497-415f-be25-4a20e3345698 => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:07:10.278515 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-a49c7995-bf0b-4ff6-9042-4f18aa956aa4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:10.279333 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-a49c7995-bf0b-4ff6-9042-4f18aa956aa4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:10.285824 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a49c7995-bf0b-4ff6-9042-4f18aa956aa4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:10.290743 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a49c7995-bf0b-4ff6-9042-4f18aa956aa4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:10.290743 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a49c7995-bf0b-4ff6-9042-4f18aa956aa4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:10.290743 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a49c7995-bf0b-4ff6-9042-4f18aa956aa4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:10.290743 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a49c7995-bf0b-4ff6-9042-4f18aa956aa4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:10.291237 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a49c7995-bf0b-4ff6-9042-4f18aa956aa4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:10.426850 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-a49c7995-bf0b-4ff6-9042-4f18aa956aa4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:10.436670 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-a49c7995-bf0b-4ff6-9042-4f18aa956aa4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:10.438528 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-a49c7995-bf0b-4ff6-9042-4f18aa956aa4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:10.440155 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-a49c7995-bf0b-4ff6-9042-4f18aa956aa4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1806 microversion: 2.20 time: 0.165366 Aug 11 11:07:10.440733 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 240/482] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:07:10 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1806 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 11:07:10.472374 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-ef32946a-5e66-458f-a141-472f5ab8bb81 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:10.473153 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-ef32946a-5e66-458f-a141-472f5ab8bb81 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] [instance: ff5a8410-e497-415f-be25-4a20e3345698] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:10.481081 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ef32946a-5e66-458f-a141-472f5ab8bb81 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:10.481603 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ef32946a-5e66-458f-a141-472f5ab8bb81 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:10.482044 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ef32946a-5e66-458f-a141-472f5ab8bb81 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:10.482747 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ef32946a-5e66-458f-a141-472f5ab8bb81 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:10.483364 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ef32946a-5e66-458f-a141-472f5ab8bb81 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:10.483864 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ef32946a-5e66-458f-a141-472f5ab8bb81 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:10.552896 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-ef32946a-5e66-458f-a141-472f5ab8bb81 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7493d38d24493b3298ac37592ecd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c8a1db00944c59950120c030ab47e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:10.560699 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-ef32946a-5e66-458f-a141-472f5ab8bb81 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] 10.222.0.48 "GET /compute/v2.1/servers/ff5a8410-e497-415f-be25-4a20e3345698" status: 200 len: 1223 microversion: 2.1 time: 0.092223 Aug 11 11:07:10.561476 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 241/483] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:07:10 2022] GET /compute/v2.1/servers/ff5a8410-e497-415f-be25-4a20e3345698 => generated 1223 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:07:11.462919 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-1704b423-9c65-4b79-9ca1-0a6d9746a006 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:11.464943 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-1704b423-9c65-4b79-9ca1-0a6d9746a006 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:11.472159 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1704b423-9c65-4b79-9ca1-0a6d9746a006 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:11.472636 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1704b423-9c65-4b79-9ca1-0a6d9746a006 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:11.473060 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1704b423-9c65-4b79-9ca1-0a6d9746a006 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:11.473746 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1704b423-9c65-4b79-9ca1-0a6d9746a006 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:11.474188 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1704b423-9c65-4b79-9ca1-0a6d9746a006 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:11.474600 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1704b423-9c65-4b79-9ca1-0a6d9746a006 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:11.618968 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-1704b423-9c65-4b79-9ca1-0a6d9746a006 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:11.630006 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-1704b423-9c65-4b79-9ca1-0a6d9746a006 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:11.633565 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-1704b423-9c65-4b79-9ca1-0a6d9746a006 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:11.633565 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-1704b423-9c65-4b79-9ca1-0a6d9746a006 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1806 microversion: 2.20 time: 0.174103 Aug 11 11:07:11.633565 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 242/484] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:07:11 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1806 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:07:11.638478 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-41af26fd-f1fa-4239-99ff-0e3efa4b4ce1 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:11.639125 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-41af26fd-f1fa-4239-99ff-0e3efa4b4ce1 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] [instance: ff5a8410-e497-415f-be25-4a20e3345698] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:11.645312 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-41af26fd-f1fa-4239-99ff-0e3efa4b4ce1 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:11.646511 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-41af26fd-f1fa-4239-99ff-0e3efa4b4ce1 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:11.647190 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-41af26fd-f1fa-4239-99ff-0e3efa4b4ce1 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:11.648146 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-41af26fd-f1fa-4239-99ff-0e3efa4b4ce1 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:11.648700 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-41af26fd-f1fa-4239-99ff-0e3efa4b4ce1 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:11.649220 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-41af26fd-f1fa-4239-99ff-0e3efa4b4ce1 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:11.929868 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-41af26fd-f1fa-4239-99ff-0e3efa4b4ce1 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7493d38d24493b3298ac37592ecd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c8a1db00944c59950120c030ab47e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:11.938773 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-41af26fd-f1fa-4239-99ff-0e3efa4b4ce1 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] 10.222.0.48 "GET /compute/v2.1/servers/ff5a8410-e497-415f-be25-4a20e3345698" status: 200 len: 1223 microversion: 2.1 time: 0.303867 Aug 11 11:07:11.939355 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 243/485] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:07:11 2022] GET /compute/v2.1/servers/ff5a8410-e497-415f-be25-4a20e3345698 => generated 1223 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:07:12.657610 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-fea18932-db6c-4bd0-84fe-37c0470be4f4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:12.659039 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-fea18932-db6c-4bd0-84fe-37c0470be4f4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:12.666891 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fea18932-db6c-4bd0-84fe-37c0470be4f4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:12.667460 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fea18932-db6c-4bd0-84fe-37c0470be4f4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:12.667994 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fea18932-db6c-4bd0-84fe-37c0470be4f4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:12.668771 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fea18932-db6c-4bd0-84fe-37c0470be4f4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:12.669341 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fea18932-db6c-4bd0-84fe-37c0470be4f4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:12.669833 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fea18932-db6c-4bd0-84fe-37c0470be4f4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:12.851786 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-fea18932-db6c-4bd0-84fe-37c0470be4f4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:12.864634 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-fea18932-db6c-4bd0-84fe-37c0470be4f4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:12.866143 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-fea18932-db6c-4bd0-84fe-37c0470be4f4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:12.867705 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-fea18932-db6c-4bd0-84fe-37c0470be4f4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1806 microversion: 2.20 time: 0.214071 Aug 11 11:07:12.868508 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 244/486] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:07:12 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1806 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:07:12.961043 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-37bca25d-e39e-4528-924e-752d7e30b0c6 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:12.961729 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-37bca25d-e39e-4528-924e-752d7e30b0c6 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] [instance: ff5a8410-e497-415f-be25-4a20e3345698] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:12.968855 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-37bca25d-e39e-4528-924e-752d7e30b0c6 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:12.971104 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-37bca25d-e39e-4528-924e-752d7e30b0c6 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:12.971104 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-37bca25d-e39e-4528-924e-752d7e30b0c6 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:12.971104 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-37bca25d-e39e-4528-924e-752d7e30b0c6 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:12.971104 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-37bca25d-e39e-4528-924e-752d7e30b0c6 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:12.971505 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-37bca25d-e39e-4528-924e-752d7e30b0c6 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:13.035445 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-37bca25d-e39e-4528-924e-752d7e30b0c6 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7493d38d24493b3298ac37592ecd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c8a1db00944c59950120c030ab47e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:13.046129 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-37bca25d-e39e-4528-924e-752d7e30b0c6 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] 10.222.0.48 "GET /compute/v2.1/servers/ff5a8410-e497-415f-be25-4a20e3345698" status: 200 len: 1223 microversion: 2.1 time: 0.088720 Aug 11 11:07:13.046934 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 245/487] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:07:12 2022] GET /compute/v2.1/servers/ff5a8410-e497-415f-be25-4a20e3345698 => generated 1223 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:07:13.892361 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-a01da677-a97b-4a97-9de5-7da77ba916f0 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:13.893061 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-a01da677-a97b-4a97-9de5-7da77ba916f0 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:13.899387 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a01da677-a97b-4a97-9de5-7da77ba916f0 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:13.899899 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a01da677-a97b-4a97-9de5-7da77ba916f0 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:13.900327 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a01da677-a97b-4a97-9de5-7da77ba916f0 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:13.901090 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a01da677-a97b-4a97-9de5-7da77ba916f0 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:13.901536 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a01da677-a97b-4a97-9de5-7da77ba916f0 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:13.901954 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a01da677-a97b-4a97-9de5-7da77ba916f0 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:14.038150 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-a01da677-a97b-4a97-9de5-7da77ba916f0 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:14.047307 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-a01da677-a97b-4a97-9de5-7da77ba916f0 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:14.048892 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-a01da677-a97b-4a97-9de5-7da77ba916f0 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:14.050270 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-a01da677-a97b-4a97-9de5-7da77ba916f0 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1806 microversion: 2.20 time: 0.162000 Aug 11 11:07:14.051079 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 246/488] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:07:13 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1806 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 11:07:14.068094 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-de52e4ab-210b-4021-94e6-bdcd8e9cbbed tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:14.068705 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-de52e4ab-210b-4021-94e6-bdcd8e9cbbed tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] [instance: ff5a8410-e497-415f-be25-4a20e3345698] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:14.074424 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-de52e4ab-210b-4021-94e6-bdcd8e9cbbed tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:14.074897 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-de52e4ab-210b-4021-94e6-bdcd8e9cbbed tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:14.075326 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-de52e4ab-210b-4021-94e6-bdcd8e9cbbed tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:14.076117 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-de52e4ab-210b-4021-94e6-bdcd8e9cbbed tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:14.076573 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-de52e4ab-210b-4021-94e6-bdcd8e9cbbed tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:14.077001 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-de52e4ab-210b-4021-94e6-bdcd8e9cbbed tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:14.137734 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-de52e4ab-210b-4021-94e6-bdcd8e9cbbed tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7493d38d24493b3298ac37592ecd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c8a1db00944c59950120c030ab47e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:14.145064 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-de52e4ab-210b-4021-94e6-bdcd8e9cbbed tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] 10.222.0.48 "GET /compute/v2.1/servers/ff5a8410-e497-415f-be25-4a20e3345698" status: 200 len: 1223 microversion: 2.1 time: 0.080602 Aug 11 11:07:14.145627 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 247/489] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:07:14 2022] GET /compute/v2.1/servers/ff5a8410-e497-415f-be25-4a20e3345698 => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:07:15.073783 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-d9f29622-f198-479b-a22b-a41150b1e0d8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:15.074455 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-d9f29622-f198-479b-a22b-a41150b1e0d8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:15.080830 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d9f29622-f198-479b-a22b-a41150b1e0d8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:15.081313 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d9f29622-f198-479b-a22b-a41150b1e0d8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:15.081744 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d9f29622-f198-479b-a22b-a41150b1e0d8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:15.082426 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d9f29622-f198-479b-a22b-a41150b1e0d8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:15.082873 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d9f29622-f198-479b-a22b-a41150b1e0d8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:15.083312 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d9f29622-f198-479b-a22b-a41150b1e0d8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:15.087300 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:07:15.220202 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d9f29622-f198-479b-a22b-a41150b1e0d8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:15.228757 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d9f29622-f198-479b-a22b-a41150b1e0d8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:15.230328 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d9f29622-f198-479b-a22b-a41150b1e0d8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:15.231491 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-d9f29622-f198-479b-a22b-a41150b1e0d8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1806 microversion: 2.20 time: 0.162134 Aug 11 11:07:15.232078 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 248/490] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:07:15 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1806 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 11:07:15.236365 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-323cb78e-8280-4104-95d5-17fbeda40422 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:15.236963 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-323cb78e-8280-4104-95d5-17fbeda40422 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] [instance: ff5a8410-e497-415f-be25-4a20e3345698] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:15.243438 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-323cb78e-8280-4104-95d5-17fbeda40422 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:15.243948 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-323cb78e-8280-4104-95d5-17fbeda40422 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:15.244383 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-323cb78e-8280-4104-95d5-17fbeda40422 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:15.245070 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-323cb78e-8280-4104-95d5-17fbeda40422 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:15.246014 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-323cb78e-8280-4104-95d5-17fbeda40422 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:15.246435 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-323cb78e-8280-4104-95d5-17fbeda40422 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:15.309292 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-323cb78e-8280-4104-95d5-17fbeda40422 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7493d38d24493b3298ac37592ecd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c8a1db00944c59950120c030ab47e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:15.316681 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-323cb78e-8280-4104-95d5-17fbeda40422 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] 10.222.0.48 "GET /compute/v2.1/servers/ff5a8410-e497-415f-be25-4a20e3345698" status: 200 len: 1223 microversion: 2.1 time: 0.083674 Aug 11 11:07:15.317273 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 249/491] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:07:15 2022] GET /compute/v2.1/servers/ff5a8410-e497-415f-be25-4a20e3345698 => generated 1223 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:07:16.116633 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell0:SELECT=2 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:07:16.254448 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-e2f036c8-b098-479a-b64b-120c667343e5 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:16.260304 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-e2f036c8-b098-479a-b64b-120c667343e5 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:16.260304 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell0:SELECT=2 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:07:16.260304 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell0:SELECT=6 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:07:16.260304 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:07:16.263859 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e2f036c8-b098-479a-b64b-120c667343e5 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:16.264336 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e2f036c8-b098-479a-b64b-120c667343e5 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:16.264764 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e2f036c8-b098-479a-b64b-120c667343e5 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:16.265435 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e2f036c8-b098-479a-b64b-120c667343e5 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:16.265876 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e2f036c8-b098-479a-b64b-120c667343e5 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:16.266291 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e2f036c8-b098-479a-b64b-120c667343e5 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:16.396803 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-e2f036c8-b098-479a-b64b-120c667343e5 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:16.405740 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-e2f036c8-b098-479a-b64b-120c667343e5 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:16.407437 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-e2f036c8-b098-479a-b64b-120c667343e5 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:16.408444 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-e2f036c8-b098-479a-b64b-120c667343e5 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1806 microversion: 2.20 time: 0.157961 Aug 11 11:07:16.409009 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 250/492] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:07:16 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1806 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 11:07:16.413343 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-32105b20-b821-42a8-9efa-36d690754fbb tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:16.413947 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-32105b20-b821-42a8-9efa-36d690754fbb tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] [instance: ff5a8410-e497-415f-be25-4a20e3345698] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:16.419643 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-32105b20-b821-42a8-9efa-36d690754fbb tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:16.420156 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-32105b20-b821-42a8-9efa-36d690754fbb tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:16.420595 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-32105b20-b821-42a8-9efa-36d690754fbb tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:16.421290 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-32105b20-b821-42a8-9efa-36d690754fbb tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:16.421745 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-32105b20-b821-42a8-9efa-36d690754fbb tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:16.422173 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-32105b20-b821-42a8-9efa-36d690754fbb tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:16.483463 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-32105b20-b821-42a8-9efa-36d690754fbb tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7493d38d24493b3298ac37592ecd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c8a1db00944c59950120c030ab47e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:16.490986 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-32105b20-b821-42a8-9efa-36d690754fbb tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] 10.222.0.48 "GET /compute/v2.1/servers/ff5a8410-e497-415f-be25-4a20e3345698" status: 200 len: 1223 microversion: 2.1 time: 0.081055 Aug 11 11:07:16.495721 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 251/493] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:07:16 2022] GET /compute/v2.1/servers/ff5a8410-e497-415f-be25-4a20e3345698 => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:07:17.432096 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-52fc3f72-2266-4ab9-8825-dbb752974fbf tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:17.433218 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-52fc3f72-2266-4ab9-8825-dbb752974fbf tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:17.439959 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-52fc3f72-2266-4ab9-8825-dbb752974fbf tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:17.440443 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-52fc3f72-2266-4ab9-8825-dbb752974fbf tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:17.440879 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-52fc3f72-2266-4ab9-8825-dbb752974fbf tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:17.441568 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-52fc3f72-2266-4ab9-8825-dbb752974fbf tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:17.442019 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-52fc3f72-2266-4ab9-8825-dbb752974fbf tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:17.442440 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-52fc3f72-2266-4ab9-8825-dbb752974fbf tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:17.576641 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-52fc3f72-2266-4ab9-8825-dbb752974fbf tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:17.585150 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-52fc3f72-2266-4ab9-8825-dbb752974fbf tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:17.586713 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-52fc3f72-2266-4ab9-8825-dbb752974fbf tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:17.587916 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-52fc3f72-2266-4ab9-8825-dbb752974fbf tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1806 microversion: 2.20 time: 0.160150 Aug 11 11:07:17.595883 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 252/494] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:07:17 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1806 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 11:07:17.595883 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-18bfc01f-5b0a-4e57-8b6b-800a732aeda9 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:17.595883 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-18bfc01f-5b0a-4e57-8b6b-800a732aeda9 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] [instance: ff5a8410-e497-415f-be25-4a20e3345698] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:17.599915 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-18bfc01f-5b0a-4e57-8b6b-800a732aeda9 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:17.600402 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-18bfc01f-5b0a-4e57-8b6b-800a732aeda9 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:17.600836 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-18bfc01f-5b0a-4e57-8b6b-800a732aeda9 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:17.601526 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-18bfc01f-5b0a-4e57-8b6b-800a732aeda9 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:17.601974 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-18bfc01f-5b0a-4e57-8b6b-800a732aeda9 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:17.602399 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-18bfc01f-5b0a-4e57-8b6b-800a732aeda9 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:17.663967 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-18bfc01f-5b0a-4e57-8b6b-800a732aeda9 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7493d38d24493b3298ac37592ecd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c8a1db00944c59950120c030ab47e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:17.671132 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-18bfc01f-5b0a-4e57-8b6b-800a732aeda9 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] 10.222.0.48 "GET /compute/v2.1/servers/ff5a8410-e497-415f-be25-4a20e3345698" status: 200 len: 1223 microversion: 2.1 time: 0.081739 Aug 11 11:07:17.671694 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 253/495] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:07:17 2022] GET /compute/v2.1/servers/ff5a8410-e497-415f-be25-4a20e3345698 => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:07:18.101294 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:07:18.178853 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell1:SELECT=74 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:07:18.610598 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-f178f25c-9a4f-405d-bd22-ab0d3bf146a6 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:18.611204 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-f178f25c-9a4f-405d-bd22-ab0d3bf146a6 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:18.618062 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f178f25c-9a4f-405d-bd22-ab0d3bf146a6 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:18.618557 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f178f25c-9a4f-405d-bd22-ab0d3bf146a6 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:18.618988 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f178f25c-9a4f-405d-bd22-ab0d3bf146a6 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:18.619678 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f178f25c-9a4f-405d-bd22-ab0d3bf146a6 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:18.620169 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f178f25c-9a4f-405d-bd22-ab0d3bf146a6 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:18.620616 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f178f25c-9a4f-405d-bd22-ab0d3bf146a6 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:18.750050 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-f178f25c-9a4f-405d-bd22-ab0d3bf146a6 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:18.758266 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-f178f25c-9a4f-405d-bd22-ab0d3bf146a6 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:18.759755 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-f178f25c-9a4f-405d-bd22-ab0d3bf146a6 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:18.761477 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-f178f25c-9a4f-405d-bd22-ab0d3bf146a6 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1806 microversion: 2.20 time: 0.154818 Aug 11 11:07:18.762031 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 254/496] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:07:18 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1806 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 11:07:18.766308 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-11e9fe43-cdde-4e1e-9eec-135b97321478 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:18.766897 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-11e9fe43-cdde-4e1e-9eec-135b97321478 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] [instance: ff5a8410-e497-415f-be25-4a20e3345698] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:18.772397 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-11e9fe43-cdde-4e1e-9eec-135b97321478 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:18.772813 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-11e9fe43-cdde-4e1e-9eec-135b97321478 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:18.773240 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-11e9fe43-cdde-4e1e-9eec-135b97321478 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:18.773911 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-11e9fe43-cdde-4e1e-9eec-135b97321478 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:18.774354 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-11e9fe43-cdde-4e1e-9eec-135b97321478 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:18.774768 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-11e9fe43-cdde-4e1e-9eec-135b97321478 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:18.834681 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-11e9fe43-cdde-4e1e-9eec-135b97321478 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7493d38d24493b3298ac37592ecd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c8a1db00944c59950120c030ab47e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:18.842798 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-11e9fe43-cdde-4e1e-9eec-135b97321478 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] 10.222.0.48 "GET /compute/v2.1/servers/ff5a8410-e497-415f-be25-4a20e3345698" status: 200 len: 1223 microversion: 2.1 time: 0.079850 Aug 11 11:07:18.843356 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 255/497] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:07:18 2022] GET /compute/v2.1/servers/ff5a8410-e497-415f-be25-4a20e3345698 => generated 1223 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:07:19.784242 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-ffa6291b-377a-4e1d-9240-589bc50b1940 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:19.784838 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-ffa6291b-377a-4e1d-9240-589bc50b1940 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:19.791161 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ffa6291b-377a-4e1d-9240-589bc50b1940 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:19.792275 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ffa6291b-377a-4e1d-9240-589bc50b1940 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:19.792709 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ffa6291b-377a-4e1d-9240-589bc50b1940 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:19.793382 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ffa6291b-377a-4e1d-9240-589bc50b1940 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:19.793826 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ffa6291b-377a-4e1d-9240-589bc50b1940 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:19.794241 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ffa6291b-377a-4e1d-9240-589bc50b1940 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:19.920939 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-ffa6291b-377a-4e1d-9240-589bc50b1940 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:19.929477 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-ffa6291b-377a-4e1d-9240-589bc50b1940 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:19.934408 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-ffa6291b-377a-4e1d-9240-589bc50b1940 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:19.934408 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-ffa6291b-377a-4e1d-9240-589bc50b1940 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1806 microversion: 2.20 time: 0.151747 Aug 11 11:07:19.934408 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 256/498] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:07:19 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1806 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 11:07:19.937303 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-37fdcb2f-16be-48dc-b16b-0d9846fcf42f tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:19.937903 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-37fdcb2f-16be-48dc-b16b-0d9846fcf42f tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] [instance: ff5a8410-e497-415f-be25-4a20e3345698] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:19.943383 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-37fdcb2f-16be-48dc-b16b-0d9846fcf42f tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:19.943885 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-37fdcb2f-16be-48dc-b16b-0d9846fcf42f tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:19.944314 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-37fdcb2f-16be-48dc-b16b-0d9846fcf42f tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:19.944985 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-37fdcb2f-16be-48dc-b16b-0d9846fcf42f tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:19.945472 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-37fdcb2f-16be-48dc-b16b-0d9846fcf42f tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:19.945956 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-37fdcb2f-16be-48dc-b16b-0d9846fcf42f tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:20.006121 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-37fdcb2f-16be-48dc-b16b-0d9846fcf42f tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7493d38d24493b3298ac37592ecd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c8a1db00944c59950120c030ab47e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:20.014057 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-37fdcb2f-16be-48dc-b16b-0d9846fcf42f tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] 10.222.0.48 "GET /compute/v2.1/servers/ff5a8410-e497-415f-be25-4a20e3345698" status: 200 len: 1223 microversion: 2.1 time: 0.080400 Aug 11 11:07:20.014686 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 257/499] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:07:19 2022] GET /compute/v2.1/servers/ff5a8410-e497-415f-be25-4a20e3345698 => generated 1223 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:07:20.954404 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-e116b691-44fb-430d-b532-e8ccd3f010bd tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:20.955013 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-e116b691-44fb-430d-b532-e8ccd3f010bd tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:20.961665 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e116b691-44fb-430d-b532-e8ccd3f010bd tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:20.969667 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e116b691-44fb-430d-b532-e8ccd3f010bd tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:20.969667 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e116b691-44fb-430d-b532-e8ccd3f010bd tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:20.969667 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e116b691-44fb-430d-b532-e8ccd3f010bd tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:20.969667 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e116b691-44fb-430d-b532-e8ccd3f010bd tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:20.970055 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e116b691-44fb-430d-b532-e8ccd3f010bd tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:21.093166 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-e116b691-44fb-430d-b532-e8ccd3f010bd tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:21.101541 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-e116b691-44fb-430d-b532-e8ccd3f010bd tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:21.103050 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-e116b691-44fb-430d-b532-e8ccd3f010bd tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:21.104752 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-e116b691-44fb-430d-b532-e8ccd3f010bd tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1806 microversion: 2.20 time: 0.153760 Aug 11 11:07:21.105324 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 258/500] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:07:20 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1806 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 11:07:21.109757 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-52406682-7d2d-4c2d-a862-850a822603c2 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:21.110367 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-52406682-7d2d-4c2d-a862-850a822603c2 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] [instance: ff5a8410-e497-415f-be25-4a20e3345698] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:21.115913 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-52406682-7d2d-4c2d-a862-850a822603c2 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:21.116398 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-52406682-7d2d-4c2d-a862-850a822603c2 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:21.116831 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-52406682-7d2d-4c2d-a862-850a822603c2 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:21.117516 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-52406682-7d2d-4c2d-a862-850a822603c2 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:21.117966 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-52406682-7d2d-4c2d-a862-850a822603c2 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:21.118389 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-52406682-7d2d-4c2d-a862-850a822603c2 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:21.178906 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-52406682-7d2d-4c2d-a862-850a822603c2 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7493d38d24493b3298ac37592ecd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c8a1db00944c59950120c030ab47e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:21.186265 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-52406682-7d2d-4c2d-a862-850a822603c2 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] 10.222.0.48 "GET /compute/v2.1/servers/ff5a8410-e497-415f-be25-4a20e3345698" status: 200 len: 1223 microversion: 2.1 time: 0.080012 Aug 11 11:07:21.186831 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 259/501] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:07:21 2022] GET /compute/v2.1/servers/ff5a8410-e497-415f-be25-4a20e3345698 => generated 1223 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:07:22.126515 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-659bfd96-3829-4678-b04b-9079c7365ed4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:22.127205 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-659bfd96-3829-4678-b04b-9079c7365ed4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:22.133757 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-659bfd96-3829-4678-b04b-9079c7365ed4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:22.134243 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-659bfd96-3829-4678-b04b-9079c7365ed4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:22.134678 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-659bfd96-3829-4678-b04b-9079c7365ed4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:22.135367 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-659bfd96-3829-4678-b04b-9079c7365ed4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:22.135848 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-659bfd96-3829-4678-b04b-9079c7365ed4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:22.136271 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-659bfd96-3829-4678-b04b-9079c7365ed4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:22.268594 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-659bfd96-3829-4678-b04b-9079c7365ed4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:22.277343 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-659bfd96-3829-4678-b04b-9079c7365ed4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:22.278876 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-659bfd96-3829-4678-b04b-9079c7365ed4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:22.280068 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-659bfd96-3829-4678-b04b-9079c7365ed4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1806 microversion: 2.20 time: 0.157426 Aug 11 11:07:22.280627 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 260/502] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:07:22 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1806 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 11:07:22.284994 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-9fe7ad19-0a00-4fc4-954d-30a7cfeedc76 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:22.285585 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-9fe7ad19-0a00-4fc4-954d-30a7cfeedc76 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] [instance: ff5a8410-e497-415f-be25-4a20e3345698] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:22.290998 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9fe7ad19-0a00-4fc4-954d-30a7cfeedc76 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:22.291474 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9fe7ad19-0a00-4fc4-954d-30a7cfeedc76 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:22.291942 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9fe7ad19-0a00-4fc4-954d-30a7cfeedc76 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:22.292620 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9fe7ad19-0a00-4fc4-954d-30a7cfeedc76 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:22.293070 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9fe7ad19-0a00-4fc4-954d-30a7cfeedc76 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:22.293485 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9fe7ad19-0a00-4fc4-954d-30a7cfeedc76 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:22.352756 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-9fe7ad19-0a00-4fc4-954d-30a7cfeedc76 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7493d38d24493b3298ac37592ecd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c8a1db00944c59950120c030ab47e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:22.360007 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-9fe7ad19-0a00-4fc4-954d-30a7cfeedc76 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] 10.222.0.48 "GET /compute/v2.1/servers/ff5a8410-e497-415f-be25-4a20e3345698" status: 200 len: 1223 microversion: 2.1 time: 0.078406 Aug 11 11:07:22.360581 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 261/503] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:07:22 2022] GET /compute/v2.1/servers/ff5a8410-e497-415f-be25-4a20e3345698 => generated 1223 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:07:23.302669 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-a82e141c-a67a-40ba-b994-3fb240f864f4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:23.303252 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-a82e141c-a67a-40ba-b994-3fb240f864f4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:23.310301 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a82e141c-a67a-40ba-b994-3fb240f864f4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:23.310773 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a82e141c-a67a-40ba-b994-3fb240f864f4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:23.311198 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a82e141c-a67a-40ba-b994-3fb240f864f4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:23.311901 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a82e141c-a67a-40ba-b994-3fb240f864f4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:23.312342 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a82e141c-a67a-40ba-b994-3fb240f864f4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:23.312755 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a82e141c-a67a-40ba-b994-3fb240f864f4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:23.438091 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-a82e141c-a67a-40ba-b994-3fb240f864f4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:23.448385 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-a82e141c-a67a-40ba-b994-3fb240f864f4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:23.449900 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-a82e141c-a67a-40ba-b994-3fb240f864f4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:23.451064 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-a82e141c-a67a-40ba-b994-3fb240f864f4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1806 microversion: 2.20 time: 0.152526 Aug 11 11:07:23.451621 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 262/504] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:07:23 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1806 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 11:07:23.456487 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-69eeb444-779f-4c95-b5f3-911022d6b2a5 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:23.457086 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-69eeb444-779f-4c95-b5f3-911022d6b2a5 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] [instance: ff5a8410-e497-415f-be25-4a20e3345698] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:23.462913 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-69eeb444-779f-4c95-b5f3-911022d6b2a5 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:23.463968 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-69eeb444-779f-4c95-b5f3-911022d6b2a5 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:23.464419 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-69eeb444-779f-4c95-b5f3-911022d6b2a5 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:23.465105 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-69eeb444-779f-4c95-b5f3-911022d6b2a5 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:23.465553 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-69eeb444-779f-4c95-b5f3-911022d6b2a5 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:23.465973 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-69eeb444-779f-4c95-b5f3-911022d6b2a5 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:23.528684 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-69eeb444-779f-4c95-b5f3-911022d6b2a5 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7493d38d24493b3298ac37592ecd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c8a1db00944c59950120c030ab47e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:23.536519 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-69eeb444-779f-4c95-b5f3-911022d6b2a5 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] 10.222.0.48 "GET /compute/v2.1/servers/ff5a8410-e497-415f-be25-4a20e3345698" status: 200 len: 1215 microversion: 2.1 time: 0.083545 Aug 11 11:07:23.536766 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 263/505] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:07:23 2022] GET /compute/v2.1/servers/ff5a8410-e497-415f-be25-4a20e3345698 => generated 1215 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:07:24.250348 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-a27ba746-c5ce-449e-8544-698e569a67bb tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "POST /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 16.161707 Aug 11 11:07:24.250963 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 243/506] 10.222.0.48 () {60 vars in 1323 bytes} [Thu Aug 11 11:07:08 2022] POST /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5/os-volume_attachments => generated 194 bytes in 16163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:07:24.474717 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-5b56df3f-5e26-4dfc-8d92-3d41d5a63c0a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:24.475296 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-5b56df3f-5e26-4dfc-8d92-3d41d5a63c0a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:24.486412 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5b56df3f-5e26-4dfc-8d92-3d41d5a63c0a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:24.486897 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5b56df3f-5e26-4dfc-8d92-3d41d5a63c0a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:24.487325 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5b56df3f-5e26-4dfc-8d92-3d41d5a63c0a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:24.488048 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5b56df3f-5e26-4dfc-8d92-3d41d5a63c0a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:24.488495 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5b56df3f-5e26-4dfc-8d92-3d41d5a63c0a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:24.488912 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5b56df3f-5e26-4dfc-8d92-3d41d5a63c0a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:24.560129 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-7959f3a8-2706-431a-8cc2-1415f95e893f tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:24.560828 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-7959f3a8-2706-431a-8cc2-1415f95e893f tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] [instance: ff5a8410-e497-415f-be25-4a20e3345698] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:24.567659 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7959f3a8-2706-431a-8cc2-1415f95e893f tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:24.568172 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7959f3a8-2706-431a-8cc2-1415f95e893f tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:24.568606 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7959f3a8-2706-431a-8cc2-1415f95e893f tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:24.569294 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7959f3a8-2706-431a-8cc2-1415f95e893f tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:24.569745 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7959f3a8-2706-431a-8cc2-1415f95e893f tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:24.570166 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7959f3a8-2706-431a-8cc2-1415f95e893f tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:24.642931 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-7959f3a8-2706-431a-8cc2-1415f95e893f tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7493d38d24493b3298ac37592ecd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c8a1db00944c59950120c030ab47e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:24.650558 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-7959f3a8-2706-431a-8cc2-1415f95e893f tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] 10.222.0.48 "GET /compute/v2.1/servers/ff5a8410-e497-415f-be25-4a20e3345698" status: 200 len: 1271 microversion: 2.1 time: 0.095831 Aug 11 11:07:24.651164 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 244/507] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:07:24 2022] GET /compute/v2.1/servers/ff5a8410-e497-415f-be25-4a20e3345698 => generated 1271 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:07:24.661023 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-5b56df3f-5e26-4dfc-8d92-3d41d5a63c0a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:24.664492 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=100 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:07:24.670371 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-5b56df3f-5e26-4dfc-8d92-3d41d5a63c0a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:24.672061 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-5b56df3f-5e26-4dfc-8d92-3d41d5a63c0a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:24.673205 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-5b56df3f-5e26-4dfc-8d92-3d41d5a63c0a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1806 microversion: 2.20 time: 0.202462 Aug 11 11:07:24.673885 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 264/508] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:07:24 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1806 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:07:25.671359 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-b813c07a-5364-44c4-9fec-541e7c069f70 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:25.671994 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-b813c07a-5364-44c4-9fec-541e7c069f70 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] [instance: ff5a8410-e497-415f-be25-4a20e3345698] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:25.678761 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b813c07a-5364-44c4-9fec-541e7c069f70 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:25.679200 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b813c07a-5364-44c4-9fec-541e7c069f70 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:25.679647 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b813c07a-5364-44c4-9fec-541e7c069f70 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:25.680360 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b813c07a-5364-44c4-9fec-541e7c069f70 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:25.680811 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b813c07a-5364-44c4-9fec-541e7c069f70 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:25.682915 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b813c07a-5364-44c4-9fec-541e7c069f70 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:25.697439 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-202d1d68-a55a-4a87-8651-c73d060bdb87 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:25.698044 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-202d1d68-a55a-4a87-8651-c73d060bdb87 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:25.704928 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-202d1d68-a55a-4a87-8651-c73d060bdb87 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:25.705424 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-202d1d68-a55a-4a87-8651-c73d060bdb87 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:25.705850 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-202d1d68-a55a-4a87-8651-c73d060bdb87 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:25.706568 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-202d1d68-a55a-4a87-8651-c73d060bdb87 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:25.707017 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-202d1d68-a55a-4a87-8651-c73d060bdb87 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:25.707440 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-202d1d68-a55a-4a87-8651-c73d060bdb87 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:25.760011 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-b813c07a-5364-44c4-9fec-541e7c069f70 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7493d38d24493b3298ac37592ecd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c8a1db00944c59950120c030ab47e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:25.768160 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-b813c07a-5364-44c4-9fec-541e7c069f70 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] 10.222.0.48 "GET /compute/v2.1/servers/ff5a8410-e497-415f-be25-4a20e3345698" status: 200 len: 1289 microversion: 2.1 time: 0.101211 Aug 11 11:07:25.768932 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 245/509] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:07:25 2022] GET /compute/v2.1/servers/ff5a8410-e497-415f-be25-4a20e3345698 => generated 1289 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:07:25.866239 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-202d1d68-a55a-4a87-8651-c73d060bdb87 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:25.874829 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-202d1d68-a55a-4a87-8651-c73d060bdb87 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:25.876378 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-202d1d68-a55a-4a87-8651-c73d060bdb87 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:25.877602 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-202d1d68-a55a-4a87-8651-c73d060bdb87 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1806 microversion: 2.20 time: 0.184021 Aug 11 11:07:25.878641 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 265/510] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:07:25 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1806 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 11:07:26.162649 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-57c2a8ea-d348-4c82-b3af-774d3673c3a1 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:26.163312 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-57c2a8ea-d348-4c82-b3af-774d3673c3a1 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] [instance: 3794302e-1657-4edd-9e15-a78592597d5b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:26.169587 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-57c2a8ea-d348-4c82-b3af-774d3673c3a1 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:26.170237 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-57c2a8ea-d348-4c82-b3af-774d3673c3a1 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:26.170670 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-57c2a8ea-d348-4c82-b3af-774d3673c3a1 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:26.171368 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-57c2a8ea-d348-4c82-b3af-774d3673c3a1 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:26.171841 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-57c2a8ea-d348-4c82-b3af-774d3673c3a1 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:26.172257 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-57c2a8ea-d348-4c82-b3af-774d3673c3a1 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:26.311731 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-57c2a8ea-d348-4c82-b3af-774d3673c3a1 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfaf5a716c5b448f8e1274de2fad307c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233f1c55781b4099be6e250e664c4fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:26.320272 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-57c2a8ea-d348-4c82-b3af-774d3673c3a1 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] 10.222.0.48 "GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b" status: 200 len: 1593 microversion: 2.1 time: 0.161381 Aug 11 11:07:26.320870 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 246/511] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:07:26 2022] GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b => generated 1593 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:07:26.789828 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-89cc9541-f2ed-4eb4-8639-24b47fe32da7 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:26.790430 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-89cc9541-f2ed-4eb4-8639-24b47fe32da7 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] [instance: ff5a8410-e497-415f-be25-4a20e3345698] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:26.797315 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-89cc9541-f2ed-4eb4-8639-24b47fe32da7 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:26.797797 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-89cc9541-f2ed-4eb4-8639-24b47fe32da7 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:26.798225 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-89cc9541-f2ed-4eb4-8639-24b47fe32da7 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:26.798945 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-89cc9541-f2ed-4eb4-8639-24b47fe32da7 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:26.799391 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-89cc9541-f2ed-4eb4-8639-24b47fe32da7 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:26.800074 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-89cc9541-f2ed-4eb4-8639-24b47fe32da7 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:26.900637 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-6235d476-b749-45b4-8a5e-e7d08ea7d679 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:26.901961 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-6235d476-b749-45b4-8a5e-e7d08ea7d679 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:26.908769 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6235d476-b749-45b4-8a5e-e7d08ea7d679 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:26.911246 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6235d476-b749-45b4-8a5e-e7d08ea7d679 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:26.911246 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6235d476-b749-45b4-8a5e-e7d08ea7d679 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:26.911246 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6235d476-b749-45b4-8a5e-e7d08ea7d679 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:26.911246 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6235d476-b749-45b4-8a5e-e7d08ea7d679 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:26.911587 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6235d476-b749-45b4-8a5e-e7d08ea7d679 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:26.968997 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-89cc9541-f2ed-4eb4-8639-24b47fe32da7 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7493d38d24493b3298ac37592ecd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c8a1db00944c59950120c030ab47e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:26.976922 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-89cc9541-f2ed-4eb4-8639-24b47fe32da7 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] 10.222.0.48 "GET /compute/v2.1/servers/ff5a8410-e497-415f-be25-4a20e3345698" status: 200 len: 1319 microversion: 2.1 time: 0.191020 Aug 11 11:07:26.977673 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 266/512] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:07:26 2022] GET /compute/v2.1/servers/ff5a8410-e497-415f-be25-4a20e3345698 => generated 1319 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:07:27.055141 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-6235d476-b749-45b4-8a5e-e7d08ea7d679 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:27.064299 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-6235d476-b749-45b4-8a5e-e7d08ea7d679 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:27.065810 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-6235d476-b749-45b4-8a5e-e7d08ea7d679 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:27.066974 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-6235d476-b749-45b4-8a5e-e7d08ea7d679 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1806 microversion: 2.20 time: 0.170734 Aug 11 11:07:27.067537 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 247/513] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:07:26 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1806 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:07:27.663235 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-79407677-d5f3-4c97-a73b-30506b19e26a req-7633defd-4440-4994-a956-5406dfbab14e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff5a8410-e497-415f-be25-4a20e3345698", "tag": "8972ea33-9084-424f-ba1b-37260a6e9da8"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:07:27.673825 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-79407677-d5f3-4c97-a73b-30506b19e26a req-7633defd-4440-4994-a956-5406dfbab14e service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:27.674216 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-79407677-d5f3-4c97-a73b-30506b19e26a req-7633defd-4440-4994-a956-5406dfbab14e service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:27.674634 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-79407677-d5f3-4c97-a73b-30506b19e26a req-7633defd-4440-4994-a956-5406dfbab14e service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:27.687545 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-79407677-d5f3-4c97-a73b-30506b19e26a req-7633defd-4440-4994-a956-5406dfbab14e service nova] Creating event network-changed:8972ea33-9084-424f-ba1b-37260a6e9da8 for instance ff5a8410-e497-415f-be25-4a20e3345698 on hv-cinder-82002 Aug 11 11:07:27.692383 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-79407677-d5f3-4c97-a73b-30506b19e26a req-7633defd-4440-4994-a956-5406dfbab14e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033064 Aug 11 11:07:27.693372 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 267/514] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:07:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:07:28.000537 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-bae7a4c5-163b-4a30-9672-421c6a6e2d40 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:28.001126 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-bae7a4c5-163b-4a30-9672-421c6a6e2d40 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] [instance: ff5a8410-e497-415f-be25-4a20e3345698] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:28.007490 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-bae7a4c5-163b-4a30-9672-421c6a6e2d40 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:28.008007 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-bae7a4c5-163b-4a30-9672-421c6a6e2d40 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:28.008443 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-bae7a4c5-163b-4a30-9672-421c6a6e2d40 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:28.009145 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-bae7a4c5-163b-4a30-9672-421c6a6e2d40 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:28.009591 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-bae7a4c5-163b-4a30-9672-421c6a6e2d40 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:28.010646 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-bae7a4c5-163b-4a30-9672-421c6a6e2d40 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:28.092475 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-1827c7dd-6849-4f83-b801-89f6a9a54017 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:28.093737 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-1827c7dd-6849-4f83-b801-89f6a9a54017 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:28.101104 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1827c7dd-6849-4f83-b801-89f6a9a54017 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:28.101704 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1827c7dd-6849-4f83-b801-89f6a9a54017 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:28.102213 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1827c7dd-6849-4f83-b801-89f6a9a54017 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:28.102983 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1827c7dd-6849-4f83-b801-89f6a9a54017 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:28.103665 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1827c7dd-6849-4f83-b801-89f6a9a54017 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:28.104350 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1827c7dd-6849-4f83-b801-89f6a9a54017 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:28.169590 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-bae7a4c5-163b-4a30-9672-421c6a6e2d40 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7493d38d24493b3298ac37592ecd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c8a1db00944c59950120c030ab47e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:28.180300 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-bae7a4c5-163b-4a30-9672-421c6a6e2d40 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] 10.222.0.48 "GET /compute/v2.1/servers/ff5a8410-e497-415f-be25-4a20e3345698" status: 200 len: 1319 microversion: 2.1 time: 0.182629 Aug 11 11:07:28.183601 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 248/515] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:07:27 2022] GET /compute/v2.1/servers/ff5a8410-e497-415f-be25-4a20e3345698 => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:07:28.264946 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-1827c7dd-6849-4f83-b801-89f6a9a54017 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:28.273423 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-1827c7dd-6849-4f83-b801-89f6a9a54017 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:28.318443 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-1827c7dd-6849-4f83-b801-89f6a9a54017 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:28.318443 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-1827c7dd-6849-4f83-b801-89f6a9a54017 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1806 microversion: 2.20 time: 0.189877 Aug 11 11:07:28.318443 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 268/516] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:07:28 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1806 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 11:07:28.513728 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-e6fd7d53-9da9-47d1-b55b-cd93bceaf8ff req-d8151279-d623-4303-beca-3ab6bf8be2ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82a61cf6-1f3f-4ced-9806-a06252b9b2cc", "name": "network-vif-plugged", "status": "completed", "tag": "71bca2c4-19df-4dc2-ad61-c7058687c043"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:07:28.527923 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-e6fd7d53-9da9-47d1-b55b-cd93bceaf8ff req-d8151279-d623-4303-beca-3ab6bf8be2ce service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:28.554472 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-e6fd7d53-9da9-47d1-b55b-cd93bceaf8ff req-d8151279-d623-4303-beca-3ab6bf8be2ce service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:28.554472 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-e6fd7d53-9da9-47d1-b55b-cd93bceaf8ff req-d8151279-d623-4303-beca-3ab6bf8be2ce service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:28.554472 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-e6fd7d53-9da9-47d1-b55b-cd93bceaf8ff req-d8151279-d623-4303-beca-3ab6bf8be2ce service nova] Creating event network-vif-plugged:71bca2c4-19df-4dc2-ad61-c7058687c043 for instance 82a61cf6-1f3f-4ced-9806-a06252b9b2cc on hv-cinder-82002 Aug 11 11:07:28.554472 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-e6fd7d53-9da9-47d1-b55b-cd93bceaf8ff req-d8151279-d623-4303-beca-3ab6bf8be2ce service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036676 Aug 11 11:07:28.554472 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 249/517] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:07:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:07:29.204921 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-c2b14a89-b3d1-429b-8a63-7626e3508517 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:29.205631 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-c2b14a89-b3d1-429b-8a63-7626e3508517 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] [instance: ff5a8410-e497-415f-be25-4a20e3345698] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:29.212455 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c2b14a89-b3d1-429b-8a63-7626e3508517 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:29.212976 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c2b14a89-b3d1-429b-8a63-7626e3508517 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:29.214401 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c2b14a89-b3d1-429b-8a63-7626e3508517 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:29.215101 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c2b14a89-b3d1-429b-8a63-7626e3508517 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:29.215559 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c2b14a89-b3d1-429b-8a63-7626e3508517 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:29.216008 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c2b14a89-b3d1-429b-8a63-7626e3508517 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:29.339922 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-73c7badb-c437-4a7f-af85-eff896d42e75 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:29.341214 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-73c7badb-c437-4a7f-af85-eff896d42e75 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:29.347839 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-73c7badb-c437-4a7f-af85-eff896d42e75 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:29.348596 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-73c7badb-c437-4a7f-af85-eff896d42e75 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:29.349224 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-73c7badb-c437-4a7f-af85-eff896d42e75 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:29.350093 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-73c7badb-c437-4a7f-af85-eff896d42e75 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:29.350717 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-73c7badb-c437-4a7f-af85-eff896d42e75 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:29.351294 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-73c7badb-c437-4a7f-af85-eff896d42e75 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:29.393312 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-c2b14a89-b3d1-429b-8a63-7626e3508517 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7493d38d24493b3298ac37592ecd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c8a1db00944c59950120c030ab47e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:29.401216 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-c2b14a89-b3d1-429b-8a63-7626e3508517 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] 10.222.0.48 "GET /compute/v2.1/servers/ff5a8410-e497-415f-be25-4a20e3345698" status: 200 len: 1319 microversion: 2.1 time: 0.200578 Aug 11 11:07:29.401938 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 269/518] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:07:29 2022] GET /compute/v2.1/servers/ff5a8410-e497-415f-be25-4a20e3345698 => generated 1319 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:07:29.502526 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-73c7badb-c437-4a7f-af85-eff896d42e75 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:29.511307 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-73c7badb-c437-4a7f-af85-eff896d42e75 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:29.512848 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-73c7badb-c437-4a7f-af85-eff896d42e75 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:29.524319 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-73c7badb-c437-4a7f-af85-eff896d42e75 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1806 microversion: 2.20 time: 0.179384 Aug 11 11:07:29.524319 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 250/519] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:07:29 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1806 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 11:07:29.889232 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-f261b134-52b1-4ad8-8de6-d131b1157a77 req-4425790f-b160-47a8-bb2e-62e133cfb066 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3794302e-1657-4edd-9e15-a78592597d5b", "tag": "8d6a01cf-8904-414f-b58d-2be53d6e73d1"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:07:29.905480 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-f261b134-52b1-4ad8-8de6-d131b1157a77 req-4425790f-b160-47a8-bb2e-62e133cfb066 service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:29.906082 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-f261b134-52b1-4ad8-8de6-d131b1157a77 req-4425790f-b160-47a8-bb2e-62e133cfb066 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:29.906512 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-f261b134-52b1-4ad8-8de6-d131b1157a77 req-4425790f-b160-47a8-bb2e-62e133cfb066 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:29.919460 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-f261b134-52b1-4ad8-8de6-d131b1157a77 req-4425790f-b160-47a8-bb2e-62e133cfb066 service nova] Creating event network-changed:8d6a01cf-8904-414f-b58d-2be53d6e73d1 for instance 3794302e-1657-4edd-9e15-a78592597d5b on hv-cinder-82002 Aug 11 11:07:29.926520 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-f261b134-52b1-4ad8-8de6-d131b1157a77 req-4425790f-b160-47a8-bb2e-62e133cfb066 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045919 Aug 11 11:07:29.927796 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 270/520] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:07:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:07:30.422763 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-b97150a1-4f9a-4de1-b665-0cd6379a5ea5 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:30.423319 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-b97150a1-4f9a-4de1-b665-0cd6379a5ea5 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] [instance: ff5a8410-e497-415f-be25-4a20e3345698] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:30.430075 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b97150a1-4f9a-4de1-b665-0cd6379a5ea5 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:30.430555 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b97150a1-4f9a-4de1-b665-0cd6379a5ea5 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:30.430977 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b97150a1-4f9a-4de1-b665-0cd6379a5ea5 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:30.431922 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b97150a1-4f9a-4de1-b665-0cd6379a5ea5 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:30.432456 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b97150a1-4f9a-4de1-b665-0cd6379a5ea5 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:30.432872 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b97150a1-4f9a-4de1-b665-0cd6379a5ea5 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:30.538674 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-06685a96-add5-46e3-82e4-d3b624ad0bf0 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:30.540153 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-06685a96-add5-46e3-82e4-d3b624ad0bf0 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:30.553950 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-06685a96-add5-46e3-82e4-d3b624ad0bf0 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:30.554442 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-06685a96-add5-46e3-82e4-d3b624ad0bf0 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:30.554871 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-06685a96-add5-46e3-82e4-d3b624ad0bf0 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:30.555775 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-06685a96-add5-46e3-82e4-d3b624ad0bf0 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:30.556243 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-06685a96-add5-46e3-82e4-d3b624ad0bf0 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:30.556724 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-06685a96-add5-46e3-82e4-d3b624ad0bf0 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:30.595340 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-b97150a1-4f9a-4de1-b665-0cd6379a5ea5 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7493d38d24493b3298ac37592ecd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c8a1db00944c59950120c030ab47e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:30.608679 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-b97150a1-4f9a-4de1-b665-0cd6379a5ea5 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] 10.222.0.48 "GET /compute/v2.1/servers/ff5a8410-e497-415f-be25-4a20e3345698" status: 200 len: 1319 microversion: 2.1 time: 0.189842 Aug 11 11:07:30.609554 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 251/521] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:07:30 2022] GET /compute/v2.1/servers/ff5a8410-e497-415f-be25-4a20e3345698 => generated 1319 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:07:30.771423 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-06685a96-add5-46e3-82e4-d3b624ad0bf0 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:30.781371 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-06685a96-add5-46e3-82e4-d3b624ad0bf0 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:30.782983 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-06685a96-add5-46e3-82e4-d3b624ad0bf0 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:30.784208 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-06685a96-add5-46e3-82e4-d3b624ad0bf0 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1806 microversion: 2.20 time: 0.250783 Aug 11 11:07:30.784772 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 271/522] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:07:30 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1806 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:07:31.630387 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-4fadcd37-1649-4acc-b871-d0f76799e50b tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:31.630990 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-4fadcd37-1649-4acc-b871-d0f76799e50b tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] [instance: ff5a8410-e497-415f-be25-4a20e3345698] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:31.638112 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4fadcd37-1649-4acc-b871-d0f76799e50b tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:31.638591 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4fadcd37-1649-4acc-b871-d0f76799e50b tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:31.639012 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4fadcd37-1649-4acc-b871-d0f76799e50b tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:31.639694 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4fadcd37-1649-4acc-b871-d0f76799e50b tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:31.640164 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4fadcd37-1649-4acc-b871-d0f76799e50b tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:31.640579 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4fadcd37-1649-4acc-b871-d0f76799e50b tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:31.784063 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-4fadcd37-1649-4acc-b871-d0f76799e50b tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7493d38d24493b3298ac37592ecd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c8a1db00944c59950120c030ab47e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:31.791978 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-4fadcd37-1649-4acc-b871-d0f76799e50b tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] 10.222.0.48 "GET /compute/v2.1/servers/ff5a8410-e497-415f-be25-4a20e3345698" status: 200 len: 1319 microversion: 2.1 time: 0.165567 Aug 11 11:07:31.792539 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 252/523] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:07:31 2022] GET /compute/v2.1/servers/ff5a8410-e497-415f-be25-4a20e3345698 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:07:31.807667 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-072dd30e-d8f5-4f94-990e-040a9431c182 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:31.808337 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-072dd30e-d8f5-4f94-990e-040a9431c182 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:31.814715 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-072dd30e-d8f5-4f94-990e-040a9431c182 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:31.815201 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-072dd30e-d8f5-4f94-990e-040a9431c182 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:31.815635 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-072dd30e-d8f5-4f94-990e-040a9431c182 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:31.816358 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-072dd30e-d8f5-4f94-990e-040a9431c182 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:31.816813 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-072dd30e-d8f5-4f94-990e-040a9431c182 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:31.817235 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-072dd30e-d8f5-4f94-990e-040a9431c182 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:31.965189 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-072dd30e-d8f5-4f94-990e-040a9431c182 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:31.975848 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-072dd30e-d8f5-4f94-990e-040a9431c182 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:31.977715 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-072dd30e-d8f5-4f94-990e-040a9431c182 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:31.979013 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-072dd30e-d8f5-4f94-990e-040a9431c182 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1806 microversion: 2.20 time: 0.176115 Aug 11 11:07:31.979657 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 272/524] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:07:31 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1806 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:07:32.813575 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-61300430-1c45-4a03-b490-2bd247b7c122 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:32.813575 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-61300430-1c45-4a03-b490-2bd247b7c122 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] [instance: ff5a8410-e497-415f-be25-4a20e3345698] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:32.823492 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-61300430-1c45-4a03-b490-2bd247b7c122 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:32.824205 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-61300430-1c45-4a03-b490-2bd247b7c122 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:32.824929 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-61300430-1c45-4a03-b490-2bd247b7c122 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:32.825959 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-61300430-1c45-4a03-b490-2bd247b7c122 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:32.826560 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-61300430-1c45-4a03-b490-2bd247b7c122 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:32.827344 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-61300430-1c45-4a03-b490-2bd247b7c122 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:32.831733 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-c2e8abd6-eb3d-4e21-a185-a7fb796da733 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1737073509"}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:07:32.832421 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-c2e8abd6-eb3d-4e21-a185-a7fb796da733 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] [instance: 3794302e-1657-4edd-9e15-a78592597d5b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:32.841111 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c2e8abd6-eb3d-4e21-a185-a7fb796da733 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:32.843152 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c2e8abd6-eb3d-4e21-a185-a7fb796da733 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:32.844102 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c2e8abd6-eb3d-4e21-a185-a7fb796da733 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:32.844861 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c2e8abd6-eb3d-4e21-a185-a7fb796da733 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:32.845346 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c2e8abd6-eb3d-4e21-a185-a7fb796da733 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:32.846318 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c2e8abd6-eb3d-4e21-a185-a7fb796da733 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:33.031755 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-61300430-1c45-4a03-b490-2bd247b7c122 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7493d38d24493b3298ac37592ecd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c8a1db00944c59950120c030ab47e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:33.039642 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-61300430-1c45-4a03-b490-2bd247b7c122 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] 10.222.0.48 "GET /compute/v2.1/servers/ff5a8410-e497-415f-be25-4a20e3345698" status: 200 len: 1319 microversion: 2.1 time: 0.230591 Aug 11 11:07:33.040056 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 253/525] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:07:32 2022] GET /compute/v2.1/servers/ff5a8410-e497-415f-be25-4a20e3345698 => generated 1319 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:07:33.042718 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.network.security_group_api [None req-c2e8abd6-eb3d-4e21-a185-a7fb796da733 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Adding security group 977b2bc8-2a1a-4c5a-b002-d610fd87a560 to port 8d6a01cf-8904-414f-b58d-2be53d6e73d1 Aug 11 11:07:33.045187 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-29d6355e-3b77-4b72-b247-8798c4b7876d tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:33.046032 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-29d6355e-3b77-4b72-b247-8798c4b7876d tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:33.054409 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-29d6355e-3b77-4b72-b247-8798c4b7876d tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:33.054928 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-29d6355e-3b77-4b72-b247-8798c4b7876d tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:33.055367 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-29d6355e-3b77-4b72-b247-8798c4b7876d tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:33.056095 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-29d6355e-3b77-4b72-b247-8798c4b7876d tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:33.056609 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-29d6355e-3b77-4b72-b247-8798c4b7876d tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:33.060692 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-29d6355e-3b77-4b72-b247-8798c4b7876d tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:33.269056 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-29d6355e-3b77-4b72-b247-8798c4b7876d tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:33.277397 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-29d6355e-3b77-4b72-b247-8798c4b7876d tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:33.278876 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-29d6355e-3b77-4b72-b247-8798c4b7876d tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:33.280140 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-29d6355e-3b77-4b72-b247-8798c4b7876d tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1806 microversion: 2.20 time: 0.239092 Aug 11 11:07:33.280622 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 254/526] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:07:33 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1806 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:07:33.482723 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-c2e8abd6-eb3d-4e21-a185-a7fb796da733 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] 10.222.0.48 "POST /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b/action" status: 202 len: 0 microversion: 2.1 time: 0.655759 Aug 11 11:07:33.483366 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 273/527] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Aug 11 11:07:32 2022] POST /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b/action => generated 0 bytes in 657 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 11:07:33.491186 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-c8ea1181-8085-4d44-abb7-4ea6d6be1a2d tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:33.491813 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-c8ea1181-8085-4d44-abb7-4ea6d6be1a2d tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] [instance: 3794302e-1657-4edd-9e15-a78592597d5b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:33.498557 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c8ea1181-8085-4d44-abb7-4ea6d6be1a2d tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:33.499046 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c8ea1181-8085-4d44-abb7-4ea6d6be1a2d tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:33.502361 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c8ea1181-8085-4d44-abb7-4ea6d6be1a2d tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:33.502361 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c8ea1181-8085-4d44-abb7-4ea6d6be1a2d tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:33.502361 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c8ea1181-8085-4d44-abb7-4ea6d6be1a2d tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:33.502361 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c8ea1181-8085-4d44-abb7-4ea6d6be1a2d tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:33.521086 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-c5dbf1e5-b778-4593-844c-459b735985e2 req-0e3bfc2a-2c65-4a34-9624-6902894152a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3794302e-1657-4edd-9e15-a78592597d5b", "tag": "8d6a01cf-8904-414f-b58d-2be53d6e73d1"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:07:33.548025 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-c5dbf1e5-b778-4593-844c-459b735985e2 req-0e3bfc2a-2c65-4a34-9624-6902894152a6 service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:33.548552 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-c5dbf1e5-b778-4593-844c-459b735985e2 req-0e3bfc2a-2c65-4a34-9624-6902894152a6 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:33.548984 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-c5dbf1e5-b778-4593-844c-459b735985e2 req-0e3bfc2a-2c65-4a34-9624-6902894152a6 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:33.567821 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-c5dbf1e5-b778-4593-844c-459b735985e2 req-0e3bfc2a-2c65-4a34-9624-6902894152a6 service nova] Creating event network-changed:8d6a01cf-8904-414f-b58d-2be53d6e73d1 for instance 3794302e-1657-4edd-9e15-a78592597d5b on hv-cinder-82002 Aug 11 11:07:33.573613 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-c5dbf1e5-b778-4593-844c-459b735985e2 req-0e3bfc2a-2c65-4a34-9624-6902894152a6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056278 Aug 11 11:07:33.574406 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 274/528] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:07:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:07:33.671777 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-c8ea1181-8085-4d44-abb7-4ea6d6be1a2d tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfaf5a716c5b448f8e1274de2fad307c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233f1c55781b4099be6e250e664c4fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:33.680301 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-c8ea1181-8085-4d44-abb7-4ea6d6be1a2d tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] 10.222.0.48 "GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b" status: 200 len: 1640 microversion: 2.1 time: 0.192834 Aug 11 11:07:33.680883 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 255/529] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:07:33 2022] GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b => generated 1640 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:07:34.062412 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-0216513d-7ebf-4274-a370-c198f7295756 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:34.063239 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-0216513d-7ebf-4274-a370-c198f7295756 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] [instance: ff5a8410-e497-415f-be25-4a20e3345698] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:34.069324 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0216513d-7ebf-4274-a370-c198f7295756 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:34.069800 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0216513d-7ebf-4274-a370-c198f7295756 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:34.070231 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0216513d-7ebf-4274-a370-c198f7295756 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:34.070957 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0216513d-7ebf-4274-a370-c198f7295756 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:34.071362 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0216513d-7ebf-4274-a370-c198f7295756 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:34.072142 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0216513d-7ebf-4274-a370-c198f7295756 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:34.206693 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-0216513d-7ebf-4274-a370-c198f7295756 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7493d38d24493b3298ac37592ecd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c8a1db00944c59950120c030ab47e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:34.214662 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-0216513d-7ebf-4274-a370-c198f7295756 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] 10.222.0.48 "GET /compute/v2.1/servers/ff5a8410-e497-415f-be25-4a20e3345698" status: 200 len: 1319 microversion: 2.1 time: 0.157557 Aug 11 11:07:34.215227 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 275/530] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:07:34 2022] GET /compute/v2.1/servers/ff5a8410-e497-415f-be25-4a20e3345698 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:07:34.302676 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-19396321-de05-465d-9c8c-2933aa4dc3b5 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:34.303389 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-19396321-de05-465d-9c8c-2933aa4dc3b5 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:34.309860 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-19396321-de05-465d-9c8c-2933aa4dc3b5 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:34.310337 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-19396321-de05-465d-9c8c-2933aa4dc3b5 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:34.310772 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-19396321-de05-465d-9c8c-2933aa4dc3b5 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:34.311504 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-19396321-de05-465d-9c8c-2933aa4dc3b5 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:34.312098 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-19396321-de05-465d-9c8c-2933aa4dc3b5 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:34.312490 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-19396321-de05-465d-9c8c-2933aa4dc3b5 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:34.444311 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-19396321-de05-465d-9c8c-2933aa4dc3b5 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:34.453488 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-19396321-de05-465d-9c8c-2933aa4dc3b5 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:34.455199 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-19396321-de05-465d-9c8c-2933aa4dc3b5 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:34.456331 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-19396321-de05-465d-9c8c-2933aa4dc3b5 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1806 microversion: 2.20 time: 0.157803 Aug 11 11:07:34.456890 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 256/531] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:07:34 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1806 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:07:35.235310 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-57c7b16d-038f-495e-b2f9-7e988e1223f1 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:35.235972 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-57c7b16d-038f-495e-b2f9-7e988e1223f1 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] [instance: ff5a8410-e497-415f-be25-4a20e3345698] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:35.242359 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-57c7b16d-038f-495e-b2f9-7e988e1223f1 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:35.242835 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-57c7b16d-038f-495e-b2f9-7e988e1223f1 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:35.243268 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-57c7b16d-038f-495e-b2f9-7e988e1223f1 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:35.244063 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-57c7b16d-038f-495e-b2f9-7e988e1223f1 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:35.245216 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-57c7b16d-038f-495e-b2f9-7e988e1223f1 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:35.245639 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-57c7b16d-038f-495e-b2f9-7e988e1223f1 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:35.372522 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-57c7b16d-038f-495e-b2f9-7e988e1223f1 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7493d38d24493b3298ac37592ecd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c8a1db00944c59950120c030ab47e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:35.379877 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-57c7b16d-038f-495e-b2f9-7e988e1223f1 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] 10.222.0.48 "GET /compute/v2.1/servers/ff5a8410-e497-415f-be25-4a20e3345698" status: 200 len: 1319 microversion: 2.1 time: 0.148471 Aug 11 11:07:35.380444 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 276/532] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:07:35 2022] GET /compute/v2.1/servers/ff5a8410-e497-415f-be25-4a20e3345698 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:07:35.479944 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-2606627d-e401-42d8-ac3f-6af3fc3b8a00 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:35.480552 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-2606627d-e401-42d8-ac3f-6af3fc3b8a00 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:35.487132 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2606627d-e401-42d8-ac3f-6af3fc3b8a00 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:35.487611 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2606627d-e401-42d8-ac3f-6af3fc3b8a00 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:35.488073 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2606627d-e401-42d8-ac3f-6af3fc3b8a00 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:35.488753 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2606627d-e401-42d8-ac3f-6af3fc3b8a00 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:35.489198 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2606627d-e401-42d8-ac3f-6af3fc3b8a00 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:35.489615 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2606627d-e401-42d8-ac3f-6af3fc3b8a00 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:35.939043 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-2606627d-e401-42d8-ac3f-6af3fc3b8a00 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:35.939043 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-2606627d-e401-42d8-ac3f-6af3fc3b8a00 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:35.940518 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-2606627d-e401-42d8-ac3f-6af3fc3b8a00 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:35.940518 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-2606627d-e401-42d8-ac3f-6af3fc3b8a00 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1806 microversion: 2.20 time: 0.173329 Aug 11 11:07:35.940518 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 257/533] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:07:35 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1806 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:07:36.400450 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-86f6476f-19f9-467d-a91e-03ada933193f tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:36.401029 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-86f6476f-19f9-467d-a91e-03ada933193f tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] [instance: ff5a8410-e497-415f-be25-4a20e3345698] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:36.408025 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-86f6476f-19f9-467d-a91e-03ada933193f tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:36.408501 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-86f6476f-19f9-467d-a91e-03ada933193f tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:36.408928 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-86f6476f-19f9-467d-a91e-03ada933193f tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:36.409604 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-86f6476f-19f9-467d-a91e-03ada933193f tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:36.410057 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-86f6476f-19f9-467d-a91e-03ada933193f tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:36.410475 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-86f6476f-19f9-467d-a91e-03ada933193f tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:36.536491 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-86f6476f-19f9-467d-a91e-03ada933193f tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7493d38d24493b3298ac37592ecd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c8a1db00944c59950120c030ab47e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:36.544752 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-86f6476f-19f9-467d-a91e-03ada933193f tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] 10.222.0.48 "GET /compute/v2.1/servers/ff5a8410-e497-415f-be25-4a20e3345698" status: 200 len: 1319 microversion: 2.1 time: 0.148737 Aug 11 11:07:36.545320 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 277/534] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:07:36 2022] GET /compute/v2.1/servers/ff5a8410-e497-415f-be25-4a20e3345698 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:07:36.597426 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-e0e59fee-7123-4793-ac58-2a340dbc1476 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:36.597972 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-e0e59fee-7123-4793-ac58-2a340dbc1476 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:36.609644 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e0e59fee-7123-4793-ac58-2a340dbc1476 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:36.609644 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e0e59fee-7123-4793-ac58-2a340dbc1476 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:36.609644 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e0e59fee-7123-4793-ac58-2a340dbc1476 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:36.609644 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e0e59fee-7123-4793-ac58-2a340dbc1476 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:36.610061 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e0e59fee-7123-4793-ac58-2a340dbc1476 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:36.610061 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e0e59fee-7123-4793-ac58-2a340dbc1476 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:36.680741 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-666b0b6c-d0ff-45b0-aa68-eac4b819ba78 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:36.680741 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-666b0b6c-d0ff-45b0-aa68-eac4b819ba78 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:36.690774 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-666b0b6c-d0ff-45b0-aa68-eac4b819ba78 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:36.691459 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-666b0b6c-d0ff-45b0-aa68-eac4b819ba78 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:36.692100 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-666b0b6c-d0ff-45b0-aa68-eac4b819ba78 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:36.692851 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-666b0b6c-d0ff-45b0-aa68-eac4b819ba78 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:36.693307 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-666b0b6c-d0ff-45b0-aa68-eac4b819ba78 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:36.693730 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-666b0b6c-d0ff-45b0-aa68-eac4b819ba78 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:36.701923 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.objects.instance [None req-e0e59fee-7123-4793-ac58-2a340dbc1476 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lazy-loading 'services' on Instance uuid 1797716b-0533-42be-8c06-750959aaf935 {{(pid=121231) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 11:07:36.832198 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-666b0b6c-d0ff-45b0-aa68-eac4b819ba78 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:36.841341 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-666b0b6c-d0ff-45b0-aa68-eac4b819ba78 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:36.842922 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-666b0b6c-d0ff-45b0-aa68-eac4b819ba78 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:36.844467 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-666b0b6c-d0ff-45b0-aa68-eac4b819ba78 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1806 microversion: 2.20 time: 0.169677 Aug 11 11:07:36.845180 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 278/535] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:07:36 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1806 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 11:07:36.851384 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-eca95177-0043-4121-8d94-c3da5329697a req-fda85c73-3b0b-4361-b289-673a5975a5bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff5a8410-e497-415f-be25-4a20e3345698", "name": "network-vif-plugged", "status": "completed", "tag": "8972ea33-9084-424f-ba1b-37260a6e9da8"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:07:36.861340 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-eca95177-0043-4121-8d94-c3da5329697a req-fda85c73-3b0b-4361-b289-673a5975a5bb service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:36.861810 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-eca95177-0043-4121-8d94-c3da5329697a req-fda85c73-3b0b-4361-b289-673a5975a5bb service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:36.862230 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-eca95177-0043-4121-8d94-c3da5329697a req-fda85c73-3b0b-4361-b289-673a5975a5bb service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:36.874741 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-eca95177-0043-4121-8d94-c3da5329697a req-fda85c73-3b0b-4361-b289-673a5975a5bb service nova] Creating event network-vif-plugged:8972ea33-9084-424f-ba1b-37260a6e9da8 for instance ff5a8410-e497-415f-be25-4a20e3345698 on hv-cinder-82002 Aug 11 11:07:36.880050 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-eca95177-0043-4121-8d94-c3da5329697a req-fda85c73-3b0b-4361-b289-673a5975a5bb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033646 Aug 11 11:07:36.880731 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 279/536] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:07:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:07:36.901014 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-e0e59fee-7123-4793-ac58-2a340dbc1476 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "DELETE /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935/os-volume_attachments/71b44e35-b32b-4eb8-ba2c-dc2e3b55fb85" status: 202 len: 0 microversion: 2.1 time: 0.307544 Aug 11 11:07:36.903340 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 258/537] 10.222.0.48 () {58 vars in 1416 bytes} [Thu Aug 11 11:07:36 2022] DELETE /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935/os-volume_attachments/71b44e35-b32b-4eb8-ba2c-dc2e3b55fb85 => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 11:07:37.565951 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-62472e49-19e2-43a8-9115-5cb86273284a tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:37.566634 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-62472e49-19e2-43a8-9115-5cb86273284a tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] [instance: ff5a8410-e497-415f-be25-4a20e3345698] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:37.573230 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-62472e49-19e2-43a8-9115-5cb86273284a tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:37.573732 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-62472e49-19e2-43a8-9115-5cb86273284a tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:37.574662 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-62472e49-19e2-43a8-9115-5cb86273284a tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:37.575376 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-62472e49-19e2-43a8-9115-5cb86273284a tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:37.575840 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-62472e49-19e2-43a8-9115-5cb86273284a tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:37.576291 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-62472e49-19e2-43a8-9115-5cb86273284a tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:37.703750 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-62472e49-19e2-43a8-9115-5cb86273284a tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7493d38d24493b3298ac37592ecd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c8a1db00944c59950120c030ab47e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:37.711129 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-62472e49-19e2-43a8-9115-5cb86273284a tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] 10.222.0.48 "GET /compute/v2.1/servers/ff5a8410-e497-415f-be25-4a20e3345698" status: 200 len: 1319 microversion: 2.1 time: 0.149330 Aug 11 11:07:37.711628 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 280/538] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:07:37 2022] GET /compute/v2.1/servers/ff5a8410-e497-415f-be25-4a20e3345698 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:07:37.868321 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-8cad9553-2069-4fa3-97ec-83762f17236c tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:37.868999 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-8cad9553-2069-4fa3-97ec-83762f17236c tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:37.875774 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8cad9553-2069-4fa3-97ec-83762f17236c tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:37.876261 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8cad9553-2069-4fa3-97ec-83762f17236c tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:37.876687 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8cad9553-2069-4fa3-97ec-83762f17236c tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:37.877359 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8cad9553-2069-4fa3-97ec-83762f17236c tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:37.877804 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8cad9553-2069-4fa3-97ec-83762f17236c tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:37.878218 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8cad9553-2069-4fa3-97ec-83762f17236c tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:37.882172 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:07:38.007878 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-8cad9553-2069-4fa3-97ec-83762f17236c tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:38.016354 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-8cad9553-2069-4fa3-97ec-83762f17236c tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:38.017885 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-8cad9553-2069-4fa3-97ec-83762f17236c tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:38.019089 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-8cad9553-2069-4fa3-97ec-83762f17236c tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1806 microversion: 2.20 time: 0.155597 Aug 11 11:07:38.019642 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 259/539] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:07:37 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1806 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:07:38.732114 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-6a4241df-7121-49ac-ab14-259ad50d6f30 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:38.732725 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-6a4241df-7121-49ac-ab14-259ad50d6f30 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] [instance: ff5a8410-e497-415f-be25-4a20e3345698] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:38.739191 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6a4241df-7121-49ac-ab14-259ad50d6f30 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:38.739598 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6a4241df-7121-49ac-ab14-259ad50d6f30 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:38.740050 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6a4241df-7121-49ac-ab14-259ad50d6f30 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:38.740732 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6a4241df-7121-49ac-ab14-259ad50d6f30 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:38.741211 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6a4241df-7121-49ac-ab14-259ad50d6f30 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:38.741629 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6a4241df-7121-49ac-ab14-259ad50d6f30 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:38.873627 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-6a4241df-7121-49ac-ab14-259ad50d6f30 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7493d38d24493b3298ac37592ecd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c8a1db00944c59950120c030ab47e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:38.880932 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-6a4241df-7121-49ac-ab14-259ad50d6f30 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] 10.222.0.48 "GET /compute/v2.1/servers/ff5a8410-e497-415f-be25-4a20e3345698" status: 200 len: 1319 microversion: 2.1 time: 0.152871 Aug 11 11:07:38.881498 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 281/540] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:07:38 2022] GET /compute/v2.1/servers/ff5a8410-e497-415f-be25-4a20e3345698 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:07:39.044182 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-0aea4df9-a102-4229-8923-3afc778ad31a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:39.044792 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-0aea4df9-a102-4229-8923-3afc778ad31a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:39.051501 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0aea4df9-a102-4229-8923-3afc778ad31a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:39.052094 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0aea4df9-a102-4229-8923-3afc778ad31a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:39.052533 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0aea4df9-a102-4229-8923-3afc778ad31a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:39.053250 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0aea4df9-a102-4229-8923-3afc778ad31a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:39.053702 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0aea4df9-a102-4229-8923-3afc778ad31a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:39.054149 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0aea4df9-a102-4229-8923-3afc778ad31a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:39.185784 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-0aea4df9-a102-4229-8923-3afc778ad31a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:39.194555 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-0aea4df9-a102-4229-8923-3afc778ad31a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:39.196137 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-0aea4df9-a102-4229-8923-3afc778ad31a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:39.197291 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-0aea4df9-a102-4229-8923-3afc778ad31a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1806 microversion: 2.20 time: 0.156981 Aug 11 11:07:39.197855 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 260/541] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:07:39 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1806 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:07:39.903960 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-a6727c37-2e94-4562-aa5b-4507aed78407 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:39.904617 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-a6727c37-2e94-4562-aa5b-4507aed78407 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] [instance: ff5a8410-e497-415f-be25-4a20e3345698] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:39.913537 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a6727c37-2e94-4562-aa5b-4507aed78407 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:39.914125 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a6727c37-2e94-4562-aa5b-4507aed78407 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:39.914877 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a6727c37-2e94-4562-aa5b-4507aed78407 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:39.916060 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a6727c37-2e94-4562-aa5b-4507aed78407 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:39.934842 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a6727c37-2e94-4562-aa5b-4507aed78407 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:39.934842 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a6727c37-2e94-4562-aa5b-4507aed78407 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:40.096922 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-a6727c37-2e94-4562-aa5b-4507aed78407 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7493d38d24493b3298ac37592ecd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c8a1db00944c59950120c030ab47e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:40.105534 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-a6727c37-2e94-4562-aa5b-4507aed78407 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] 10.222.0.48 "GET /compute/v2.1/servers/ff5a8410-e497-415f-be25-4a20e3345698" status: 200 len: 1319 microversion: 2.1 time: 0.206400 Aug 11 11:07:40.106249 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 282/542] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:07:39 2022] GET /compute/v2.1/servers/ff5a8410-e497-415f-be25-4a20e3345698 => generated 1319 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:07:40.221207 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-ac89cab4-21d0-478b-b429-4bc31bd32360 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:40.221901 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-ac89cab4-21d0-478b-b429-4bc31bd32360 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:40.228399 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ac89cab4-21d0-478b-b429-4bc31bd32360 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:40.228892 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ac89cab4-21d0-478b-b429-4bc31bd32360 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:40.229336 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ac89cab4-21d0-478b-b429-4bc31bd32360 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:40.230076 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ac89cab4-21d0-478b-b429-4bc31bd32360 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:40.231074 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ac89cab4-21d0-478b-b429-4bc31bd32360 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:40.231497 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ac89cab4-21d0-478b-b429-4bc31bd32360 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:40.373553 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-ac89cab4-21d0-478b-b429-4bc31bd32360 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:40.382243 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-ac89cab4-21d0-478b-b429-4bc31bd32360 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:40.383858 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-ac89cab4-21d0-478b-b429-4bc31bd32360 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:40.385010 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-ac89cab4-21d0-478b-b429-4bc31bd32360 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1806 microversion: 2.20 time: 0.168162 Aug 11 11:07:40.385569 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 261/543] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:07:40 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1806 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 11:07:41.135879 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-3976829c-b1ec-4c05-95f2-7fe5c359043c tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:41.137087 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-3976829c-b1ec-4c05-95f2-7fe5c359043c tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] [instance: ff5a8410-e497-415f-be25-4a20e3345698] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:41.143460 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3976829c-b1ec-4c05-95f2-7fe5c359043c tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:41.143979 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3976829c-b1ec-4c05-95f2-7fe5c359043c tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:41.144410 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3976829c-b1ec-4c05-95f2-7fe5c359043c tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:41.145093 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3976829c-b1ec-4c05-95f2-7fe5c359043c tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:41.145543 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3976829c-b1ec-4c05-95f2-7fe5c359043c tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:41.145979 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3976829c-b1ec-4c05-95f2-7fe5c359043c tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:41.282534 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-3976829c-b1ec-4c05-95f2-7fe5c359043c tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7493d38d24493b3298ac37592ecd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c8a1db00944c59950120c030ab47e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:41.290682 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-3976829c-b1ec-4c05-95f2-7fe5c359043c tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] 10.222.0.48 "GET /compute/v2.1/servers/ff5a8410-e497-415f-be25-4a20e3345698" status: 200 len: 1319 microversion: 2.1 time: 0.158596 Aug 11 11:07:41.291275 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 283/544] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:07:41 2022] GET /compute/v2.1/servers/ff5a8410-e497-415f-be25-4a20e3345698 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:07:41.410062 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-244c0aa2-079e-4c96-8ecb-c8008d9c8ff1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:41.410636 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-244c0aa2-079e-4c96-8ecb-c8008d9c8ff1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:41.417081 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-244c0aa2-079e-4c96-8ecb-c8008d9c8ff1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:41.418052 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-244c0aa2-079e-4c96-8ecb-c8008d9c8ff1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:41.418480 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-244c0aa2-079e-4c96-8ecb-c8008d9c8ff1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:41.419193 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-244c0aa2-079e-4c96-8ecb-c8008d9c8ff1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:41.419639 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-244c0aa2-079e-4c96-8ecb-c8008d9c8ff1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:41.420083 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-244c0aa2-079e-4c96-8ecb-c8008d9c8ff1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:41.554452 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-244c0aa2-079e-4c96-8ecb-c8008d9c8ff1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:41.563934 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-244c0aa2-079e-4c96-8ecb-c8008d9c8ff1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:41.565472 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-244c0aa2-079e-4c96-8ecb-c8008d9c8ff1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:41.566788 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-244c0aa2-079e-4c96-8ecb-c8008d9c8ff1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1806 microversion: 2.20 time: 0.162003 Aug 11 11:07:41.567295 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 262/545] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:07:41 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1806 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:07:42.313016 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-cb2cdcca-fdb1-40ea-aed4-ced66f9dd326 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:42.313621 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-cb2cdcca-fdb1-40ea-aed4-ced66f9dd326 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] [instance: ff5a8410-e497-415f-be25-4a20e3345698] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:42.320068 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cb2cdcca-fdb1-40ea-aed4-ced66f9dd326 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:42.320544 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cb2cdcca-fdb1-40ea-aed4-ced66f9dd326 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:42.320976 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cb2cdcca-fdb1-40ea-aed4-ced66f9dd326 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:42.321727 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cb2cdcca-fdb1-40ea-aed4-ced66f9dd326 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:42.322177 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cb2cdcca-fdb1-40ea-aed4-ced66f9dd326 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:42.322597 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cb2cdcca-fdb1-40ea-aed4-ced66f9dd326 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:42.342232 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=100 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:07:42.451242 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-6d246bc9-1e6e-4ff3-a79d-55d0ae94af19 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:07:42.453686 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-6d246bc9-1e6e-4ff3-a79d-55d0ae94af19 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 481c1d02-4070-4d58-8be2-438cd1a68eb5] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:42.460780 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6d246bc9-1e6e-4ff3-a79d-55d0ae94af19 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:42.461377 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6d246bc9-1e6e-4ff3-a79d-55d0ae94af19 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:42.461879 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6d246bc9-1e6e-4ff3-a79d-55d0ae94af19 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:42.462641 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6d246bc9-1e6e-4ff3-a79d-55d0ae94af19 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:42.463151 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6d246bc9-1e6e-4ff3-a79d-55d0ae94af19 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:42.463827 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6d246bc9-1e6e-4ff3-a79d-55d0ae94af19 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:42.478277 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-cb2cdcca-fdb1-40ea-aed4-ced66f9dd326 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7493d38d24493b3298ac37592ecd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c8a1db00944c59950120c030ab47e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:42.486489 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-cb2cdcca-fdb1-40ea-aed4-ced66f9dd326 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] 10.222.0.48 "GET /compute/v2.1/servers/ff5a8410-e497-415f-be25-4a20e3345698" status: 200 len: 1319 microversion: 2.1 time: 0.177471 Aug 11 11:07:42.487041 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 284/546] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:07:42 2022] GET /compute/v2.1/servers/ff5a8410-e497-415f-be25-4a20e3345698 => generated 1319 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:07:42.489831 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.objects.instance [None req-6d246bc9-1e6e-4ff3-a79d-55d0ae94af19 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lazy-loading 'flavor' on Instance uuid 481c1d02-4070-4d58-8be2-438cd1a68eb5 {{(pid=121231) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 11:07:42.590097 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-fd3e559c-8e40-42e9-a392-21bd74306727 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:42.590619 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-fd3e559c-8e40-42e9-a392-21bd74306727 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:42.597101 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fd3e559c-8e40-42e9-a392-21bd74306727 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:42.597711 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fd3e559c-8e40-42e9-a392-21bd74306727 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:42.598219 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fd3e559c-8e40-42e9-a392-21bd74306727 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:42.599154 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fd3e559c-8e40-42e9-a392-21bd74306727 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:42.599708 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fd3e559c-8e40-42e9-a392-21bd74306727 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:42.600238 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fd3e559c-8e40-42e9-a392-21bd74306727 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:42.735211 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-fd3e559c-8e40-42e9-a392-21bd74306727 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:42.743785 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-fd3e559c-8e40-42e9-a392-21bd74306727 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:42.745316 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-fd3e559c-8e40-42e9-a392-21bd74306727 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:42.746531 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-fd3e559c-8e40-42e9-a392-21bd74306727 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1793 microversion: 2.20 time: 0.160905 Aug 11 11:07:42.747090 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 285/547] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:07:42 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1793 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:07:42.876949 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-6d246bc9-1e6e-4ff3-a79d-55d0ae94af19 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "POST /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5/action" status: 200 len: 32 microversion: 2.1 time: 0.429847 Aug 11 11:07:42.877479 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 263/548] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Aug 11 11:07:42 2022] POST /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5/action => generated 32 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 11 11:07:42.887349 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-d20a0052-d38a-418b-a112-fd988d9c1307 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:42.888018 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-d20a0052-d38a-418b-a112-fd988d9c1307 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 481c1d02-4070-4d58-8be2-438cd1a68eb5] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:42.893958 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d20a0052-d38a-418b-a112-fd988d9c1307 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:42.894439 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d20a0052-d38a-418b-a112-fd988d9c1307 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:42.894879 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d20a0052-d38a-418b-a112-fd988d9c1307 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:42.895563 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d20a0052-d38a-418b-a112-fd988d9c1307 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:42.896049 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d20a0052-d38a-418b-a112-fd988d9c1307 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:42.896482 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d20a0052-d38a-418b-a112-fd988d9c1307 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:43.023956 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d20a0052-d38a-418b-a112-fd988d9c1307 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:43.032549 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-d20a0052-d38a-418b-a112-fd988d9c1307 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5" status: 200 len: 1734 microversion: 2.1 time: 0.149594 Aug 11 11:07:43.033108 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 286/549] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:07:42 2022] GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:07:43.512174 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-29a80a60-2c0f-4af4-a150-2d8e4f19ed1b tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:43.512877 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-29a80a60-2c0f-4af4-a150-2d8e4f19ed1b tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] [instance: ff5a8410-e497-415f-be25-4a20e3345698] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:43.519558 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-29a80a60-2c0f-4af4-a150-2d8e4f19ed1b tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:43.520098 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-29a80a60-2c0f-4af4-a150-2d8e4f19ed1b tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:43.520524 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-29a80a60-2c0f-4af4-a150-2d8e4f19ed1b tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:43.521212 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-29a80a60-2c0f-4af4-a150-2d8e4f19ed1b tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:43.521671 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-29a80a60-2c0f-4af4-a150-2d8e4f19ed1b tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:43.522090 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-29a80a60-2c0f-4af4-a150-2d8e4f19ed1b tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:43.713977 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-29a80a60-2c0f-4af4-a150-2d8e4f19ed1b tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7493d38d24493b3298ac37592ecd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c8a1db00944c59950120c030ab47e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:43.720749 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-29a80a60-2c0f-4af4-a150-2d8e4f19ed1b tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] 10.222.0.48 "GET /compute/v2.1/servers/ff5a8410-e497-415f-be25-4a20e3345698" status: 200 len: 1509 microversion: 2.1 time: 0.213383 Aug 11 11:07:43.721647 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 264/550] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:07:43 2022] GET /compute/v2.1/servers/ff5a8410-e497-415f-be25-4a20e3345698 => generated 1509 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:07:43.746244 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-dc301074-4f0b-4950-b1ef-77c885fa8ef2 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "efe574cb-1758-4a09-b77a-bc90aa300a9c", "device": "/dev/sdb"}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:07:43.749580 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-dc301074-4f0b-4950-b1ef-77c885fa8ef2 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] [instance: ff5a8410-e497-415f-be25-4a20e3345698] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:43.761138 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dc301074-4f0b-4950-b1ef-77c885fa8ef2 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:43.761965 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dc301074-4f0b-4950-b1ef-77c885fa8ef2 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:43.762459 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dc301074-4f0b-4950-b1ef-77c885fa8ef2 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:43.763432 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dc301074-4f0b-4950-b1ef-77c885fa8ef2 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:43.764069 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dc301074-4f0b-4950-b1ef-77c885fa8ef2 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:43.764485 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dc301074-4f0b-4950-b1ef-77c885fa8ef2 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:44.054372 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-6c5cc41f-ca51-4026-aedd-af133441df21 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:44.055162 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-6c5cc41f-ca51-4026-aedd-af133441df21 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 481c1d02-4070-4d58-8be2-438cd1a68eb5] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:44.061770 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6c5cc41f-ca51-4026-aedd-af133441df21 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:44.064045 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6c5cc41f-ca51-4026-aedd-af133441df21 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:44.064045 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6c5cc41f-ca51-4026-aedd-af133441df21 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:44.064045 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6c5cc41f-ca51-4026-aedd-af133441df21 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:44.064045 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6c5cc41f-ca51-4026-aedd-af133441df21 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:44.064504 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6c5cc41f-ca51-4026-aedd-af133441df21 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:44.227272 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-6c5cc41f-ca51-4026-aedd-af133441df21 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:44.235985 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-6c5cc41f-ca51-4026-aedd-af133441df21 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5" status: 200 len: 1734 microversion: 2.1 time: 0.186129 Aug 11 11:07:44.236788 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 265/551] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:07:44 2022] GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5 => generated 1734 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:07:44.383237 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-b701cb50-1d9b-4b08-9c7d-2d91f4a9f86b tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:07:44.389887 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b701cb50-1d9b-4b08-9c7d-2d91f4a9f86b tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:44.390376 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b701cb50-1d9b-4b08-9c7d-2d91f4a9f86b tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:44.402184 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b701cb50-1d9b-4b08-9c7d-2d91f4a9f86b tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:44.414592 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-b701cb50-1d9b-4b08-9c7d-2d91f4a9f86b tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Going to try to stop instance {{(pid=121231) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 11 11:07:44.669709 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-b701cb50-1d9b-4b08-9c7d-2d91f4a9f86b tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "POST /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935/action" status: 202 len: 0 microversion: 2.1 time: 0.290373 Aug 11 11:07:44.670422 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 266/552] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Aug 11 11:07:44 2022] POST /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935/action => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 11:07:44.679134 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-99976245-d8da-4394-827c-dd92a8e392ff tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:44.679860 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-99976245-d8da-4394-827c-dd92a8e392ff tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:44.686451 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-99976245-d8da-4394-827c-dd92a8e392ff tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:44.687040 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-99976245-d8da-4394-827c-dd92a8e392ff tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:44.687684 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-99976245-d8da-4394-827c-dd92a8e392ff tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:44.688574 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-99976245-d8da-4394-827c-dd92a8e392ff tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:44.689028 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-99976245-d8da-4394-827c-dd92a8e392ff tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:44.689451 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-99976245-d8da-4394-827c-dd92a8e392ff tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:44.696200 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-dc301074-4f0b-4950-b1ef-77c885fa8ef2 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] 10.222.0.48 "POST /compute/v2.1/servers/ff5a8410-e497-415f-be25-4a20e3345698/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.957419 Aug 11 11:07:44.697071 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 287/553] 10.222.0.48 () {60 vars in 1323 bytes} [Thu Aug 11 11:07:43 2022] POST /compute/v2.1/servers/ff5a8410-e497-415f-be25-4a20e3345698/os-volume_attachments => generated 194 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:07:44.836050 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-99976245-d8da-4394-827c-dd92a8e392ff tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:44.843696 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-99976245-d8da-4394-827c-dd92a8e392ff tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1678 microversion: 2.1 time: 0.168684 Aug 11 11:07:44.844242 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 267/554] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:07:44 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1678 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:07:45.257337 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-7b50a56a-57d8-48a5-85c1-5cd6fd695523 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:45.258021 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-7b50a56a-57d8-48a5-85c1-5cd6fd695523 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 481c1d02-4070-4d58-8be2-438cd1a68eb5] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:45.265027 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7b50a56a-57d8-48a5-85c1-5cd6fd695523 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:45.265502 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7b50a56a-57d8-48a5-85c1-5cd6fd695523 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:45.265930 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7b50a56a-57d8-48a5-85c1-5cd6fd695523 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:45.266608 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7b50a56a-57d8-48a5-85c1-5cd6fd695523 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:45.267051 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7b50a56a-57d8-48a5-85c1-5cd6fd695523 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:45.267467 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7b50a56a-57d8-48a5-85c1-5cd6fd695523 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:45.398903 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-7b50a56a-57d8-48a5-85c1-5cd6fd695523 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:45.406974 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-7b50a56a-57d8-48a5-85c1-5cd6fd695523 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5" status: 200 len: 1734 microversion: 2.1 time: 0.153878 Aug 11 11:07:45.407538 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 288/555] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:07:45 2022] GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:07:45.867938 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-ee77f326-71a2-404d-9965-ac667a67b3c5 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:45.868479 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-ee77f326-71a2-404d-9965-ac667a67b3c5 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:45.875616 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ee77f326-71a2-404d-9965-ac667a67b3c5 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:45.876149 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ee77f326-71a2-404d-9965-ac667a67b3c5 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:45.876544 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ee77f326-71a2-404d-9965-ac667a67b3c5 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:45.877219 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ee77f326-71a2-404d-9965-ac667a67b3c5 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:45.877661 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ee77f326-71a2-404d-9965-ac667a67b3c5 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:45.878109 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ee77f326-71a2-404d-9965-ac667a67b3c5 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:46.017408 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-ee77f326-71a2-404d-9965-ac667a67b3c5 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:46.025082 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-ee77f326-71a2-404d-9965-ac667a67b3c5 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1678 microversion: 2.1 time: 0.161013 Aug 11 11:07:46.025648 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 268/556] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:07:45 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:07:46.430740 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-e292d196-f362-4d15-b431-5d4f09f300c1 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:46.431348 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-e292d196-f362-4d15-b431-5d4f09f300c1 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 481c1d02-4070-4d58-8be2-438cd1a68eb5] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:46.438420 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e292d196-f362-4d15-b431-5d4f09f300c1 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:46.438895 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e292d196-f362-4d15-b431-5d4f09f300c1 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:46.439329 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e292d196-f362-4d15-b431-5d4f09f300c1 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:46.440196 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e292d196-f362-4d15-b431-5d4f09f300c1 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:46.440826 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e292d196-f362-4d15-b431-5d4f09f300c1 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:46.441243 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e292d196-f362-4d15-b431-5d4f09f300c1 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:46.572736 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-e292d196-f362-4d15-b431-5d4f09f300c1 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:46.582359 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-e292d196-f362-4d15-b431-5d4f09f300c1 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5" status: 200 len: 1734 microversion: 2.1 time: 0.156993 Aug 11 11:07:46.582935 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 289/557] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:07:46 2022] GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:07:47.046484 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-23bcabc6-5aab-4568-b50c-287ec11a8722 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:47.047092 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-23bcabc6-5aab-4568-b50c-287ec11a8722 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:47.053949 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-23bcabc6-5aab-4568-b50c-287ec11a8722 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:47.054535 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-23bcabc6-5aab-4568-b50c-287ec11a8722 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:47.054975 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-23bcabc6-5aab-4568-b50c-287ec11a8722 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:47.055661 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-23bcabc6-5aab-4568-b50c-287ec11a8722 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:47.056158 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-23bcabc6-5aab-4568-b50c-287ec11a8722 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:47.056585 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-23bcabc6-5aab-4568-b50c-287ec11a8722 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:47.203352 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-23bcabc6-5aab-4568-b50c-287ec11a8722 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:47.211079 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-23bcabc6-5aab-4568-b50c-287ec11a8722 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1678 microversion: 2.1 time: 0.168503 Aug 11 11:07:47.211693 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 269/558] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:07:47 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1678 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:07:47.607071 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-e3a3e78e-d9f0-41db-849f-2810e6812b6e tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:47.607709 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-e3a3e78e-d9f0-41db-849f-2810e6812b6e tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 481c1d02-4070-4d58-8be2-438cd1a68eb5] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:47.610334 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_api:SELECT=80 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:07:47.615318 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e3a3e78e-d9f0-41db-849f-2810e6812b6e tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:47.615825 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e3a3e78e-d9f0-41db-849f-2810e6812b6e tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:47.616262 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e3a3e78e-d9f0-41db-849f-2810e6812b6e tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:47.617093 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e3a3e78e-d9f0-41db-849f-2810e6812b6e tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:47.617595 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e3a3e78e-d9f0-41db-849f-2810e6812b6e tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:47.618023 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e3a3e78e-d9f0-41db-849f-2810e6812b6e tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:47.749306 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-e3a3e78e-d9f0-41db-849f-2810e6812b6e tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:47.757428 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-e3a3e78e-d9f0-41db-849f-2810e6812b6e tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5" status: 200 len: 1734 microversion: 2.1 time: 0.154762 Aug 11 11:07:47.757992 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 290/559] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:07:47 2022] GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:07:48.231978 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-01bd0714-a663-4726-8759-b73612f4ac16 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:48.232569 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-01bd0714-a663-4726-8759-b73612f4ac16 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:48.239070 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-01bd0714-a663-4726-8759-b73612f4ac16 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:48.239550 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-01bd0714-a663-4726-8759-b73612f4ac16 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:48.240016 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-01bd0714-a663-4726-8759-b73612f4ac16 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:48.240698 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-01bd0714-a663-4726-8759-b73612f4ac16 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:48.241150 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-01bd0714-a663-4726-8759-b73612f4ac16 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:48.241570 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-01bd0714-a663-4726-8759-b73612f4ac16 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:48.374960 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-01bd0714-a663-4726-8759-b73612f4ac16 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:48.382479 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-01bd0714-a663-4726-8759-b73612f4ac16 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1678 microversion: 2.1 time: 0.154938 Aug 11 11:07:48.383045 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 270/560] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:07:48 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:07:48.778683 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-b48f9e08-dc33-4208-932d-15ff85fa83f4 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:48.779268 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-b48f9e08-dc33-4208-932d-15ff85fa83f4 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 481c1d02-4070-4d58-8be2-438cd1a68eb5] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:48.785873 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b48f9e08-dc33-4208-932d-15ff85fa83f4 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:48.786345 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b48f9e08-dc33-4208-932d-15ff85fa83f4 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:48.786770 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b48f9e08-dc33-4208-932d-15ff85fa83f4 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:48.787440 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b48f9e08-dc33-4208-932d-15ff85fa83f4 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:48.787908 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b48f9e08-dc33-4208-932d-15ff85fa83f4 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:48.788325 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b48f9e08-dc33-4208-932d-15ff85fa83f4 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:48.924483 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-b48f9e08-dc33-4208-932d-15ff85fa83f4 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:48.932512 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-b48f9e08-dc33-4208-932d-15ff85fa83f4 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5" status: 200 len: 1734 microversion: 2.1 time: 0.158238 Aug 11 11:07:48.933094 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 291/561] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:07:48 2022] GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5 => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:07:49.402930 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-67ddd3fc-7b6c-4937-9bdb-50ab5ed4e9c6 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:49.403542 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-67ddd3fc-7b6c-4937-9bdb-50ab5ed4e9c6 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:49.405990 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_api:SELECT=55 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:07:49.410779 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-67ddd3fc-7b6c-4937-9bdb-50ab5ed4e9c6 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:49.411296 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-67ddd3fc-7b6c-4937-9bdb-50ab5ed4e9c6 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:49.415977 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-67ddd3fc-7b6c-4937-9bdb-50ab5ed4e9c6 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:49.415977 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-67ddd3fc-7b6c-4937-9bdb-50ab5ed4e9c6 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:49.415977 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-67ddd3fc-7b6c-4937-9bdb-50ab5ed4e9c6 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:49.415977 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-67ddd3fc-7b6c-4937-9bdb-50ab5ed4e9c6 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:49.542227 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-67ddd3fc-7b6c-4937-9bdb-50ab5ed4e9c6 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:49.550097 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-67ddd3fc-7b6c-4937-9bdb-50ab5ed4e9c6 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1678 microversion: 2.1 time: 0.151056 Aug 11 11:07:49.550670 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 271/562] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:07:49 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:07:49.962388 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-9c058b31-5077-4737-92b4-550fcea7e12e tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:49.962972 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-9c058b31-5077-4737-92b4-550fcea7e12e tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 481c1d02-4070-4d58-8be2-438cd1a68eb5] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:49.969914 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9c058b31-5077-4737-92b4-550fcea7e12e tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:49.970391 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9c058b31-5077-4737-92b4-550fcea7e12e tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:49.970881 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9c058b31-5077-4737-92b4-550fcea7e12e tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:49.971566 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9c058b31-5077-4737-92b4-550fcea7e12e tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:49.972042 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9c058b31-5077-4737-92b4-550fcea7e12e tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:49.972460 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9c058b31-5077-4737-92b4-550fcea7e12e tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:50.108912 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-9c058b31-5077-4737-92b4-550fcea7e12e tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:50.116998 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-9c058b31-5077-4737-92b4-550fcea7e12e tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5" status: 200 len: 1734 microversion: 2.1 time: 0.158427 Aug 11 11:07:50.117941 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 292/563] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:07:49 2022] GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5 => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:07:50.571648 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-7d4358a7-7318-4aed-8e3c-64557da13c2e tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:50.572319 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-7d4358a7-7318-4aed-8e3c-64557da13c2e tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:50.579234 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7d4358a7-7318-4aed-8e3c-64557da13c2e tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:50.579711 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7d4358a7-7318-4aed-8e3c-64557da13c2e tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:50.580441 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7d4358a7-7318-4aed-8e3c-64557da13c2e tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:50.581121 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7d4358a7-7318-4aed-8e3c-64557da13c2e tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:50.581569 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7d4358a7-7318-4aed-8e3c-64557da13c2e tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:50.581987 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7d4358a7-7318-4aed-8e3c-64557da13c2e tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:50.710461 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-7d4358a7-7318-4aed-8e3c-64557da13c2e tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:50.715647 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:07:50.720026 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-7d4358a7-7318-4aed-8e3c-64557da13c2e tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1678 microversion: 2.1 time: 0.152532 Aug 11 11:07:50.724691 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 272/564] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:07:50 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:07:51.137947 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-c43755c5-25a2-4c57-86d4-e375a25c196e tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:51.138550 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-c43755c5-25a2-4c57-86d4-e375a25c196e tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 481c1d02-4070-4d58-8be2-438cd1a68eb5] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:51.144955 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c43755c5-25a2-4c57-86d4-e375a25c196e tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:51.145432 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c43755c5-25a2-4c57-86d4-e375a25c196e tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:51.145862 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c43755c5-25a2-4c57-86d4-e375a25c196e tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:51.146535 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c43755c5-25a2-4c57-86d4-e375a25c196e tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:51.147049 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c43755c5-25a2-4c57-86d4-e375a25c196e tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:51.147410 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c43755c5-25a2-4c57-86d4-e375a25c196e tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:51.288060 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-c43755c5-25a2-4c57-86d4-e375a25c196e tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:51.298053 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-c43755c5-25a2-4c57-86d4-e375a25c196e tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5" status: 200 len: 1734 microversion: 2.1 time: 0.163907 Aug 11 11:07:51.299047 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 293/565] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:07:51 2022] GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5 => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:07:51.741153 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-865636d2-9b27-40ca-bacf-220bac35a3bf tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:51.741750 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-865636d2-9b27-40ca-bacf-220bac35a3bf tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:51.748510 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-865636d2-9b27-40ca-bacf-220bac35a3bf tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:51.748983 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-865636d2-9b27-40ca-bacf-220bac35a3bf tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:51.749461 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-865636d2-9b27-40ca-bacf-220bac35a3bf tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:51.750174 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-865636d2-9b27-40ca-bacf-220bac35a3bf tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:51.750624 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-865636d2-9b27-40ca-bacf-220bac35a3bf tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:51.751083 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-865636d2-9b27-40ca-bacf-220bac35a3bf tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:51.781697 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-9051a06d-c01f-40c3-bd7d-4a5f7e8a81ba tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:07:51.784164 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-9051a06d-c01f-40c3-bd7d-4a5f7e8a81ba tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] [instance: 3794302e-1657-4edd-9e15-a78592597d5b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:51.790144 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9051a06d-c01f-40c3-bd7d-4a5f7e8a81ba tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:51.790763 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9051a06d-c01f-40c3-bd7d-4a5f7e8a81ba tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:51.792318 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9051a06d-c01f-40c3-bd7d-4a5f7e8a81ba tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:51.792663 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9051a06d-c01f-40c3-bd7d-4a5f7e8a81ba tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:51.793188 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9051a06d-c01f-40c3-bd7d-4a5f7e8a81ba tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:51.793681 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9051a06d-c01f-40c3-bd7d-4a5f7e8a81ba tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:51.882744 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-865636d2-9b27-40ca-bacf-220bac35a3bf tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:51.891219 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-865636d2-9b27-40ca-bacf-220bac35a3bf tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1678 microversion: 2.1 time: 0.154239 Aug 11 11:07:51.891844 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 273/566] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:07:51 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:07:51.967351 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-9051a06d-c01f-40c3-bd7d-4a5f7e8a81ba tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] 10.222.0.48 "POST /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b/action" status: 202 len: 0 microversion: 2.1 time: 0.189295 Aug 11 11:07:51.968027 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 294/567] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Aug 11 11:07:51 2022] POST /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b/action => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 11:07:51.976171 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-1f562367-ab1b-4de2-a354-230760445d4e tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:51.976792 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-1f562367-ab1b-4de2-a354-230760445d4e tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] [instance: 3794302e-1657-4edd-9e15-a78592597d5b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:51.983005 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1f562367-ab1b-4de2-a354-230760445d4e tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:51.983578 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1f562367-ab1b-4de2-a354-230760445d4e tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:51.984027 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1f562367-ab1b-4de2-a354-230760445d4e tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:51.984704 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1f562367-ab1b-4de2-a354-230760445d4e tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:51.985146 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1f562367-ab1b-4de2-a354-230760445d4e tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:51.985562 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1f562367-ab1b-4de2-a354-230760445d4e tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:52.129588 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-1f562367-ab1b-4de2-a354-230760445d4e tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfaf5a716c5b448f8e1274de2fad307c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233f1c55781b4099be6e250e664c4fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:52.138497 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-1f562367-ab1b-4de2-a354-230760445d4e tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] 10.222.0.48 "GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b" status: 200 len: 1751 microversion: 2.1 time: 0.166127 Aug 11 11:07:52.139283 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 274/568] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:07:51 2022] GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b => generated 1751 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:07:52.321183 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-e7c78baa-bc39-4849-9682-2ba4bff6084b tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:52.321956 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-e7c78baa-bc39-4849-9682-2ba4bff6084b tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 481c1d02-4070-4d58-8be2-438cd1a68eb5] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:52.328955 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e7c78baa-bc39-4849-9682-2ba4bff6084b tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:52.329439 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e7c78baa-bc39-4849-9682-2ba4bff6084b tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:52.329873 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e7c78baa-bc39-4849-9682-2ba4bff6084b tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:52.330550 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e7c78baa-bc39-4849-9682-2ba4bff6084b tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:52.330997 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e7c78baa-bc39-4849-9682-2ba4bff6084b tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:52.331418 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e7c78baa-bc39-4849-9682-2ba4bff6084b tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:52.467573 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-e7c78baa-bc39-4849-9682-2ba4bff6084b tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:52.475638 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-e7c78baa-bc39-4849-9682-2ba4bff6084b tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5" status: 200 len: 1734 microversion: 2.1 time: 0.159945 Aug 11 11:07:52.476256 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 295/569] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:07:52 2022] GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5 => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:07:52.913131 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-db022d1d-820c-4a10-a030-8fc3a1a9bf49 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:52.913717 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-db022d1d-820c-4a10-a030-8fc3a1a9bf49 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:52.920715 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-db022d1d-820c-4a10-a030-8fc3a1a9bf49 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:52.921184 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-db022d1d-820c-4a10-a030-8fc3a1a9bf49 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:52.921614 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-db022d1d-820c-4a10-a030-8fc3a1a9bf49 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:52.922299 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-db022d1d-820c-4a10-a030-8fc3a1a9bf49 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:52.922748 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-db022d1d-820c-4a10-a030-8fc3a1a9bf49 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:52.923166 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-db022d1d-820c-4a10-a030-8fc3a1a9bf49 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:53.060015 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-db022d1d-820c-4a10-a030-8fc3a1a9bf49 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:53.068079 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-db022d1d-820c-4a10-a030-8fc3a1a9bf49 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1678 microversion: 2.1 time: 0.158845 Aug 11 11:07:53.068652 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 275/570] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:07:52 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:07:53.161017 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-50167b02-8cfb-400e-af8f-c876d2dbe96c tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:53.162022 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-50167b02-8cfb-400e-af8f-c876d2dbe96c tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] [instance: 3794302e-1657-4edd-9e15-a78592597d5b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:53.168663 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-50167b02-8cfb-400e-af8f-c876d2dbe96c tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:53.172720 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-50167b02-8cfb-400e-af8f-c876d2dbe96c tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:53.172720 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-50167b02-8cfb-400e-af8f-c876d2dbe96c tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:53.172720 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-50167b02-8cfb-400e-af8f-c876d2dbe96c tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:53.172720 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-50167b02-8cfb-400e-af8f-c876d2dbe96c tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:53.173923 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-50167b02-8cfb-400e-af8f-c876d2dbe96c tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:53.319713 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-50167b02-8cfb-400e-af8f-c876d2dbe96c tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfaf5a716c5b448f8e1274de2fad307c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233f1c55781b4099be6e250e664c4fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:53.328738 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-50167b02-8cfb-400e-af8f-c876d2dbe96c tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] 10.222.0.48 "GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b" status: 200 len: 1751 microversion: 2.1 time: 0.171557 Aug 11 11:07:53.329387 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 296/571] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:07:53 2022] GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b => generated 1751 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:07:53.496307 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-6e9495d6-837a-4527-a0c7-548b901de003 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:53.496962 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-6e9495d6-837a-4527-a0c7-548b901de003 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 481c1d02-4070-4d58-8be2-438cd1a68eb5] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:53.502872 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6e9495d6-837a-4527-a0c7-548b901de003 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:53.503353 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6e9495d6-837a-4527-a0c7-548b901de003 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:53.503806 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6e9495d6-837a-4527-a0c7-548b901de003 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:53.504493 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6e9495d6-837a-4527-a0c7-548b901de003 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:53.504942 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6e9495d6-837a-4527-a0c7-548b901de003 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:53.505364 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6e9495d6-837a-4527-a0c7-548b901de003 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:53.652471 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-6e9495d6-837a-4527-a0c7-548b901de003 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:53.660440 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-6e9495d6-837a-4527-a0c7-548b901de003 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5" status: 200 len: 1734 microversion: 2.1 time: 0.168039 Aug 11 11:07:53.661010 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 276/572] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:07:53 2022] GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5 => generated 1734 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:07:54.088965 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-27a00728-329c-498b-a0bb-332c6c33c5dc tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:54.089592 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-27a00728-329c-498b-a0bb-332c6c33c5dc tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:54.095573 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-27a00728-329c-498b-a0bb-332c6c33c5dc tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:54.096026 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-27a00728-329c-498b-a0bb-332c6c33c5dc tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:54.096454 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-27a00728-329c-498b-a0bb-332c6c33c5dc tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:54.097134 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-27a00728-329c-498b-a0bb-332c6c33c5dc tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:54.097581 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-27a00728-329c-498b-a0bb-332c6c33c5dc tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:54.097998 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-27a00728-329c-498b-a0bb-332c6c33c5dc tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:54.224600 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-27a00728-329c-498b-a0bb-332c6c33c5dc tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:54.232466 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-27a00728-329c-498b-a0bb-332c6c33c5dc tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1678 microversion: 2.1 time: 0.147448 Aug 11 11:07:54.233031 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 297/573] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:07:54 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:07:54.350408 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-7f673e85-1ef3-4ddf-84e9-dbbc69cfb1a3 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:54.350942 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-7f673e85-1ef3-4ddf-84e9-dbbc69cfb1a3 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] [instance: 3794302e-1657-4edd-9e15-a78592597d5b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:54.357816 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7f673e85-1ef3-4ddf-84e9-dbbc69cfb1a3 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:54.358297 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7f673e85-1ef3-4ddf-84e9-dbbc69cfb1a3 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:54.358719 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7f673e85-1ef3-4ddf-84e9-dbbc69cfb1a3 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:54.359402 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7f673e85-1ef3-4ddf-84e9-dbbc69cfb1a3 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:54.359877 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7f673e85-1ef3-4ddf-84e9-dbbc69cfb1a3 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:54.360299 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7f673e85-1ef3-4ddf-84e9-dbbc69cfb1a3 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:54.505438 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-7f673e85-1ef3-4ddf-84e9-dbbc69cfb1a3 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfaf5a716c5b448f8e1274de2fad307c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233f1c55781b4099be6e250e664c4fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:54.513521 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-7f673e85-1ef3-4ddf-84e9-dbbc69cfb1a3 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] 10.222.0.48 "GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b" status: 200 len: 1756 microversion: 2.1 time: 0.166979 Aug 11 11:07:54.514094 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 277/574] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:07:54 2022] GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:07:54.682235 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-32b7d883-acb3-4344-b272-0fe3bd45b580 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:54.682844 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-32b7d883-acb3-4344-b272-0fe3bd45b580 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 481c1d02-4070-4d58-8be2-438cd1a68eb5] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:54.689476 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-32b7d883-acb3-4344-b272-0fe3bd45b580 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:54.689965 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-32b7d883-acb3-4344-b272-0fe3bd45b580 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:54.690397 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-32b7d883-acb3-4344-b272-0fe3bd45b580 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:54.691080 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-32b7d883-acb3-4344-b272-0fe3bd45b580 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:54.691531 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-32b7d883-acb3-4344-b272-0fe3bd45b580 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:54.691986 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-32b7d883-acb3-4344-b272-0fe3bd45b580 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:54.820469 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-32b7d883-acb3-4344-b272-0fe3bd45b580 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:54.824737 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:07:54.829674 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-32b7d883-acb3-4344-b272-0fe3bd45b580 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5" status: 200 len: 1734 microversion: 2.1 time: 0.151457 Aug 11 11:07:54.830243 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 298/575] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:07:54 2022] GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:07:55.253893 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-17423355-aa3e-4aab-8046-eb9c47915405 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:55.254502 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-17423355-aa3e-4aab-8046-eb9c47915405 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:55.260517 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-17423355-aa3e-4aab-8046-eb9c47915405 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:55.261562 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-17423355-aa3e-4aab-8046-eb9c47915405 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:55.261993 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-17423355-aa3e-4aab-8046-eb9c47915405 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:55.262670 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-17423355-aa3e-4aab-8046-eb9c47915405 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:55.263123 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-17423355-aa3e-4aab-8046-eb9c47915405 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:55.263543 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-17423355-aa3e-4aab-8046-eb9c47915405 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:55.405433 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-17423355-aa3e-4aab-8046-eb9c47915405 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:55.413124 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-17423355-aa3e-4aab-8046-eb9c47915405 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1678 microversion: 2.1 time: 0.163082 Aug 11 11:07:55.413687 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 278/576] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:07:55 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:07:55.536113 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-66aabccc-d4d0-4cc6-83b8-aa104998bc83 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:55.536725 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-66aabccc-d4d0-4cc6-83b8-aa104998bc83 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] [instance: 3794302e-1657-4edd-9e15-a78592597d5b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:55.543049 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-66aabccc-d4d0-4cc6-83b8-aa104998bc83 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:55.548830 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-66aabccc-d4d0-4cc6-83b8-aa104998bc83 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:55.548830 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-66aabccc-d4d0-4cc6-83b8-aa104998bc83 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:55.548830 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-66aabccc-d4d0-4cc6-83b8-aa104998bc83 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:55.548830 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-66aabccc-d4d0-4cc6-83b8-aa104998bc83 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:55.549197 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-66aabccc-d4d0-4cc6-83b8-aa104998bc83 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:55.695874 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-66aabccc-d4d0-4cc6-83b8-aa104998bc83 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfaf5a716c5b448f8e1274de2fad307c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233f1c55781b4099be6e250e664c4fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:55.704056 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-66aabccc-d4d0-4cc6-83b8-aa104998bc83 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] 10.222.0.48 "GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b" status: 200 len: 1756 microversion: 2.1 time: 0.172288 Aug 11 11:07:55.704620 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 299/577] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:07:55 2022] GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:07:55.852236 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-b1b052ce-c04b-4d79-8d87-5ce719e42b96 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:55.852815 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-b1b052ce-c04b-4d79-8d87-5ce719e42b96 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 481c1d02-4070-4d58-8be2-438cd1a68eb5] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:55.859397 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b1b052ce-c04b-4d79-8d87-5ce719e42b96 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:55.859909 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b1b052ce-c04b-4d79-8d87-5ce719e42b96 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:55.860341 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b1b052ce-c04b-4d79-8d87-5ce719e42b96 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:55.861022 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b1b052ce-c04b-4d79-8d87-5ce719e42b96 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:55.861471 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b1b052ce-c04b-4d79-8d87-5ce719e42b96 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:55.861893 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b1b052ce-c04b-4d79-8d87-5ce719e42b96 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:55.989549 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-b1b052ce-c04b-4d79-8d87-5ce719e42b96 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:55.997887 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-b1b052ce-c04b-4d79-8d87-5ce719e42b96 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5" status: 200 len: 1734 microversion: 2.1 time: 0.149483 Aug 11 11:07:55.998213 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 279/578] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:07:55 2022] GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:07:56.434377 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-cb624d4d-495a-4f9e-a1b3-13f2723eb520 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:56.435041 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-cb624d4d-495a-4f9e-a1b3-13f2723eb520 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:56.441298 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cb624d4d-495a-4f9e-a1b3-13f2723eb520 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:56.443138 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cb624d4d-495a-4f9e-a1b3-13f2723eb520 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:56.443138 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cb624d4d-495a-4f9e-a1b3-13f2723eb520 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:56.443138 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cb624d4d-495a-4f9e-a1b3-13f2723eb520 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:56.443429 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cb624d4d-495a-4f9e-a1b3-13f2723eb520 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:56.443728 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cb624d4d-495a-4f9e-a1b3-13f2723eb520 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:56.574944 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-cb624d4d-495a-4f9e-a1b3-13f2723eb520 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:56.582561 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-cb624d4d-495a-4f9e-a1b3-13f2723eb520 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1678 microversion: 2.1 time: 0.152104 Aug 11 11:07:56.583121 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 300/579] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:07:56 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:07:56.724682 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-4192eac2-95ec-4794-9620-5e7184c09af6 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:56.725295 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-4192eac2-95ec-4794-9620-5e7184c09af6 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] [instance: 3794302e-1657-4edd-9e15-a78592597d5b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:56.731738 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4192eac2-95ec-4794-9620-5e7184c09af6 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:56.732262 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4192eac2-95ec-4794-9620-5e7184c09af6 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:56.732717 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4192eac2-95ec-4794-9620-5e7184c09af6 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:56.733414 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4192eac2-95ec-4794-9620-5e7184c09af6 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:56.733851 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4192eac2-95ec-4794-9620-5e7184c09af6 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:56.734277 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4192eac2-95ec-4794-9620-5e7184c09af6 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:56.873352 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-4192eac2-95ec-4794-9620-5e7184c09af6 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfaf5a716c5b448f8e1274de2fad307c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233f1c55781b4099be6e250e664c4fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:56.881400 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-4192eac2-95ec-4794-9620-5e7184c09af6 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] 10.222.0.48 "GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b" status: 200 len: 1756 microversion: 2.1 time: 0.160827 Aug 11 11:07:56.881969 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 280/580] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:07:56 2022] GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:07:57.018730 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-5525dc2f-f372-4b30-b64d-086be8c28678 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:57.019259 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-5525dc2f-f372-4b30-b64d-086be8c28678 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 481c1d02-4070-4d58-8be2-438cd1a68eb5] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:57.025729 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5525dc2f-f372-4b30-b64d-086be8c28678 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:57.026212 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5525dc2f-f372-4b30-b64d-086be8c28678 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:57.026644 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5525dc2f-f372-4b30-b64d-086be8c28678 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:57.027356 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5525dc2f-f372-4b30-b64d-086be8c28678 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:57.027830 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5525dc2f-f372-4b30-b64d-086be8c28678 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:57.028258 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5525dc2f-f372-4b30-b64d-086be8c28678 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:57.156643 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-5525dc2f-f372-4b30-b64d-086be8c28678 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:57.165614 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-5525dc2f-f372-4b30-b64d-086be8c28678 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5" status: 200 len: 1734 microversion: 2.1 time: 0.150747 Aug 11 11:07:57.166196 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 301/581] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:07:57 2022] GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:07:57.605270 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-bc4bc40d-d36d-4229-a137-292640dc556d tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:57.605388 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-bc4bc40d-d36d-4229-a137-292640dc556d tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:57.611398 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-bc4bc40d-d36d-4229-a137-292640dc556d tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:57.611926 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-bc4bc40d-d36d-4229-a137-292640dc556d tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:57.612370 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-bc4bc40d-d36d-4229-a137-292640dc556d tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:57.613053 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-bc4bc40d-d36d-4229-a137-292640dc556d tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:57.613507 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-bc4bc40d-d36d-4229-a137-292640dc556d tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:57.613931 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-bc4bc40d-d36d-4229-a137-292640dc556d tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:57.741882 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-bc4bc40d-d36d-4229-a137-292640dc556d tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:57.749474 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-bc4bc40d-d36d-4229-a137-292640dc556d tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1678 microversion: 2.1 time: 0.149096 Aug 11 11:07:57.750041 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 281/582] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:07:57 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:07:57.903518 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-aa1902a2-f386-401e-958d-ac2743747169 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:57.904083 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-aa1902a2-f386-401e-958d-ac2743747169 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] [instance: 3794302e-1657-4edd-9e15-a78592597d5b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:57.910120 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-aa1902a2-f386-401e-958d-ac2743747169 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:57.910597 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-aa1902a2-f386-401e-958d-ac2743747169 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:57.911029 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-aa1902a2-f386-401e-958d-ac2743747169 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:57.911706 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-aa1902a2-f386-401e-958d-ac2743747169 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:57.912182 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-aa1902a2-f386-401e-958d-ac2743747169 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:57.912602 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-aa1902a2-f386-401e-958d-ac2743747169 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:58.051552 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-aa1902a2-f386-401e-958d-ac2743747169 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfaf5a716c5b448f8e1274de2fad307c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233f1c55781b4099be6e250e664c4fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:58.059472 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-aa1902a2-f386-401e-958d-ac2743747169 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] 10.222.0.48 "GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b" status: 200 len: 1756 microversion: 2.1 time: 0.160429 Aug 11 11:07:58.060073 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 302/583] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:07:57 2022] GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:07:58.187771 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-29a5f410-70f5-48e1-8e9e-89b41cd4d0be tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:58.188393 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-29a5f410-70f5-48e1-8e9e-89b41cd4d0be tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 481c1d02-4070-4d58-8be2-438cd1a68eb5] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:58.194437 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-29a5f410-70f5-48e1-8e9e-89b41cd4d0be tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:58.194912 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-29a5f410-70f5-48e1-8e9e-89b41cd4d0be tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:58.195341 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-29a5f410-70f5-48e1-8e9e-89b41cd4d0be tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:58.196051 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-29a5f410-70f5-48e1-8e9e-89b41cd4d0be tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:58.196496 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-29a5f410-70f5-48e1-8e9e-89b41cd4d0be tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:58.196911 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-29a5f410-70f5-48e1-8e9e-89b41cd4d0be tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:58.326118 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-29a5f410-70f5-48e1-8e9e-89b41cd4d0be tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:58.333921 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-29a5f410-70f5-48e1-8e9e-89b41cd4d0be tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5" status: 200 len: 1734 microversion: 2.1 time: 0.150006 Aug 11 11:07:58.334480 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 282/584] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:07:58 2022] GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:07:58.769929 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-d3e22ab5-d083-45f2-b520-480f371f61f3 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:58.770530 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-d3e22ab5-d083-45f2-b520-480f371f61f3 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:58.776584 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d3e22ab5-d083-45f2-b520-480f371f61f3 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:58.777062 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d3e22ab5-d083-45f2-b520-480f371f61f3 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:58.777489 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d3e22ab5-d083-45f2-b520-480f371f61f3 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:58.778170 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d3e22ab5-d083-45f2-b520-480f371f61f3 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:58.778613 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d3e22ab5-d083-45f2-b520-480f371f61f3 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:58.779027 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d3e22ab5-d083-45f2-b520-480f371f61f3 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:58.909888 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d3e22ab5-d083-45f2-b520-480f371f61f3 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:58.918231 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-d3e22ab5-d083-45f2-b520-480f371f61f3 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1678 microversion: 2.1 time: 0.151964 Aug 11 11:07:58.918856 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 303/585] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:07:58 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:07:59.080221 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-6c5c2ed7-16c7-4595-834f-386852c30d4c tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:59.080859 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-6c5c2ed7-16c7-4595-834f-386852c30d4c tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] [instance: 3794302e-1657-4edd-9e15-a78592597d5b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:59.087165 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6c5c2ed7-16c7-4595-834f-386852c30d4c tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:59.087679 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6c5c2ed7-16c7-4595-834f-386852c30d4c tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:59.088191 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6c5c2ed7-16c7-4595-834f-386852c30d4c tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:59.089383 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6c5c2ed7-16c7-4595-834f-386852c30d4c tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:59.089835 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6c5c2ed7-16c7-4595-834f-386852c30d4c tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:59.090257 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6c5c2ed7-16c7-4595-834f-386852c30d4c tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:59.235599 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-6c5c2ed7-16c7-4595-834f-386852c30d4c tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfaf5a716c5b448f8e1274de2fad307c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233f1c55781b4099be6e250e664c4fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:59.243986 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-6c5c2ed7-16c7-4595-834f-386852c30d4c tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] 10.222.0.48 "GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b" status: 200 len: 1756 microversion: 2.1 time: 0.167599 Aug 11 11:07:59.244665 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 283/586] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:07:59 2022] GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:07:59.354640 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-98623c79-524d-4a83-be4c-c1755900c8dc tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:59.355248 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-98623c79-524d-4a83-be4c-c1755900c8dc tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 481c1d02-4070-4d58-8be2-438cd1a68eb5] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:59.361784 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-98623c79-524d-4a83-be4c-c1755900c8dc tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:59.362262 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-98623c79-524d-4a83-be4c-c1755900c8dc tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:59.362695 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-98623c79-524d-4a83-be4c-c1755900c8dc tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:59.363386 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-98623c79-524d-4a83-be4c-c1755900c8dc tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:59.363860 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-98623c79-524d-4a83-be4c-c1755900c8dc tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:59.364286 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-98623c79-524d-4a83-be4c-c1755900c8dc tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:59.490623 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-98623c79-524d-4a83-be4c-c1755900c8dc tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:07:59.498647 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-98623c79-524d-4a83-be4c-c1755900c8dc tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5" status: 200 len: 1734 microversion: 2.1 time: 0.147918 Aug 11 11:07:59.499219 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 304/587] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:07:59 2022] GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5 => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:07:59.939059 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-b30f0632-405a-460d-a2d2-ff53ecc75a43 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:07:59.939674 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-b30f0632-405a-460d-a2d2-ff53ecc75a43 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:07:59.945655 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b30f0632-405a-460d-a2d2-ff53ecc75a43 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:59.946054 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b30f0632-405a-460d-a2d2-ff53ecc75a43 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:59.946480 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b30f0632-405a-460d-a2d2-ff53ecc75a43 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:07:59.947161 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b30f0632-405a-460d-a2d2-ff53ecc75a43 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:07:59.947607 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b30f0632-405a-460d-a2d2-ff53ecc75a43 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:07:59.948743 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b30f0632-405a-460d-a2d2-ff53ecc75a43 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:00.076246 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-b30f0632-405a-460d-a2d2-ff53ecc75a43 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:00.083733 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-b30f0632-405a-460d-a2d2-ff53ecc75a43 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1678 microversion: 2.1 time: 0.148653 Aug 11 11:08:00.084319 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 284/588] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:07:59 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:08:00.265282 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-d9b98fa8-2ac2-401d-8de1-61273da49267 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:08:00.265886 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-d9b98fa8-2ac2-401d-8de1-61273da49267 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] [instance: 3794302e-1657-4edd-9e15-a78592597d5b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:08:00.271739 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d9b98fa8-2ac2-401d-8de1-61273da49267 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:00.272241 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d9b98fa8-2ac2-401d-8de1-61273da49267 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:00.272663 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d9b98fa8-2ac2-401d-8de1-61273da49267 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:00.273331 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d9b98fa8-2ac2-401d-8de1-61273da49267 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:00.273773 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d9b98fa8-2ac2-401d-8de1-61273da49267 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:00.274189 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d9b98fa8-2ac2-401d-8de1-61273da49267 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:00.415124 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d9b98fa8-2ac2-401d-8de1-61273da49267 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfaf5a716c5b448f8e1274de2fad307c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233f1c55781b4099be6e250e664c4fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:00.423821 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-d9b98fa8-2ac2-401d-8de1-61273da49267 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] 10.222.0.48 "GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b" status: 200 len: 1756 microversion: 2.1 time: 0.162314 Aug 11 11:08:00.424391 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 305/589] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:08:00 2022] GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:08:00.520033 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-718c9337-cf49-4d8d-91e7-6c0aa44bec33 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:08:00.520573 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-718c9337-cf49-4d8d-91e7-6c0aa44bec33 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 481c1d02-4070-4d58-8be2-438cd1a68eb5] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:08:00.527360 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-718c9337-cf49-4d8d-91e7-6c0aa44bec33 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:00.527863 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-718c9337-cf49-4d8d-91e7-6c0aa44bec33 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:00.528301 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-718c9337-cf49-4d8d-91e7-6c0aa44bec33 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:00.528980 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-718c9337-cf49-4d8d-91e7-6c0aa44bec33 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:00.529432 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-718c9337-cf49-4d8d-91e7-6c0aa44bec33 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:00.529854 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-718c9337-cf49-4d8d-91e7-6c0aa44bec33 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:00.655910 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-718c9337-cf49-4d8d-91e7-6c0aa44bec33 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:00.663826 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-718c9337-cf49-4d8d-91e7-6c0aa44bec33 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5" status: 200 len: 1734 microversion: 2.1 time: 0.147768 Aug 11 11:08:00.664394 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 285/590] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:08:00 2022] GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5 => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:08:01.105881 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-5c7784a7-6dec-4c4d-a449-4d3b163bd811 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:08:01.106415 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-5c7784a7-6dec-4c4d-a449-4d3b163bd811 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:08:01.112441 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5c7784a7-6dec-4c4d-a449-4d3b163bd811 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:01.112927 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5c7784a7-6dec-4c4d-a449-4d3b163bd811 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:01.113367 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5c7784a7-6dec-4c4d-a449-4d3b163bd811 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:01.114051 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5c7784a7-6dec-4c4d-a449-4d3b163bd811 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:01.114507 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5c7784a7-6dec-4c4d-a449-4d3b163bd811 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:01.114931 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5c7784a7-6dec-4c4d-a449-4d3b163bd811 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:01.242893 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-5c7784a7-6dec-4c4d-a449-4d3b163bd811 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:01.251084 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-5c7784a7-6dec-4c4d-a449-4d3b163bd811 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1678 microversion: 2.1 time: 0.149215 Aug 11 11:08:01.251653 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 306/591] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:08:01 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:08:01.445093 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-89150935-6f2a-4b10-817e-5c7f5ceb90ea tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:08:01.445707 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-89150935-6f2a-4b10-817e-5c7f5ceb90ea tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] [instance: 3794302e-1657-4edd-9e15-a78592597d5b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:08:01.452380 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-89150935-6f2a-4b10-817e-5c7f5ceb90ea tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:01.452862 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-89150935-6f2a-4b10-817e-5c7f5ceb90ea tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:01.453296 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-89150935-6f2a-4b10-817e-5c7f5ceb90ea tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:01.453999 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-89150935-6f2a-4b10-817e-5c7f5ceb90ea tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:01.454451 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-89150935-6f2a-4b10-817e-5c7f5ceb90ea tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:01.454872 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-89150935-6f2a-4b10-817e-5c7f5ceb90ea tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:01.591966 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-89150935-6f2a-4b10-817e-5c7f5ceb90ea tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfaf5a716c5b448f8e1274de2fad307c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233f1c55781b4099be6e250e664c4fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:01.599945 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-89150935-6f2a-4b10-817e-5c7f5ceb90ea tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] 10.222.0.48 "GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b" status: 200 len: 1756 microversion: 2.1 time: 0.158693 Aug 11 11:08:01.600508 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 286/592] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:08:01 2022] GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b => generated 1756 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:08:01.685717 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-d8b7c910-709a-4bc7-a6d6-ad62b98ef0e6 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:08:01.686360 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-d8b7c910-709a-4bc7-a6d6-ad62b98ef0e6 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 481c1d02-4070-4d58-8be2-438cd1a68eb5] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:08:01.693004 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d8b7c910-709a-4bc7-a6d6-ad62b98ef0e6 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:01.693485 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d8b7c910-709a-4bc7-a6d6-ad62b98ef0e6 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:01.693915 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d8b7c910-709a-4bc7-a6d6-ad62b98ef0e6 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:01.694625 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d8b7c910-709a-4bc7-a6d6-ad62b98ef0e6 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:01.695156 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d8b7c910-709a-4bc7-a6d6-ad62b98ef0e6 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:01.695512 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d8b7c910-709a-4bc7-a6d6-ad62b98ef0e6 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:02.029071 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d8b7c910-709a-4bc7-a6d6-ad62b98ef0e6 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:02.037344 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-d8b7c910-709a-4bc7-a6d6-ad62b98ef0e6 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5" status: 200 len: 1734 microversion: 2.1 time: 0.356241 Aug 11 11:08:02.037905 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 307/593] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:08:01 2022] GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5 => generated 1734 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:08:02.272264 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-b88de4c3-7fb1-4f7f-919b-e5c2eec6f4ae tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:08:02.272868 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-b88de4c3-7fb1-4f7f-919b-e5c2eec6f4ae tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:08:02.279228 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b88de4c3-7fb1-4f7f-919b-e5c2eec6f4ae tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:02.279712 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b88de4c3-7fb1-4f7f-919b-e5c2eec6f4ae tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:02.280179 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b88de4c3-7fb1-4f7f-919b-e5c2eec6f4ae tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:02.280866 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b88de4c3-7fb1-4f7f-919b-e5c2eec6f4ae tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:02.281316 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b88de4c3-7fb1-4f7f-919b-e5c2eec6f4ae tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:02.281738 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b88de4c3-7fb1-4f7f-919b-e5c2eec6f4ae tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:02.407933 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-b88de4c3-7fb1-4f7f-919b-e5c2eec6f4ae tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:02.415716 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-b88de4c3-7fb1-4f7f-919b-e5c2eec6f4ae tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1678 microversion: 2.1 time: 0.147208 Aug 11 11:08:02.416353 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 287/594] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:08:02 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1678 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:08:02.622369 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-bd5aa1a6-8d26-4c81-bf9d-5a669ec9e8ce tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:08:02.623025 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-bd5aa1a6-8d26-4c81-bf9d-5a669ec9e8ce tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] [instance: 3794302e-1657-4edd-9e15-a78592597d5b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:08:02.629134 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bd5aa1a6-8d26-4c81-bf9d-5a669ec9e8ce tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:02.629614 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bd5aa1a6-8d26-4c81-bf9d-5a669ec9e8ce tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:02.630043 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bd5aa1a6-8d26-4c81-bf9d-5a669ec9e8ce tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:02.630729 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bd5aa1a6-8d26-4c81-bf9d-5a669ec9e8ce tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:02.631179 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bd5aa1a6-8d26-4c81-bf9d-5a669ec9e8ce tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:02.631606 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bd5aa1a6-8d26-4c81-bf9d-5a669ec9e8ce tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:02.778528 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-bd5aa1a6-8d26-4c81-bf9d-5a669ec9e8ce tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfaf5a716c5b448f8e1274de2fad307c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233f1c55781b4099be6e250e664c4fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:02.786574 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-bd5aa1a6-8d26-4c81-bf9d-5a669ec9e8ce tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] 10.222.0.48 "GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b" status: 200 len: 1756 microversion: 2.1 time: 0.168177 Aug 11 11:08:02.787138 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 308/595] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:08:02 2022] GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:08:03.058878 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-cdadbd77-14b0-4ebe-a39b-37f35f365d67 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:08:03.059488 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-cdadbd77-14b0-4ebe-a39b-37f35f365d67 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 481c1d02-4070-4d58-8be2-438cd1a68eb5] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:08:03.066008 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-cdadbd77-14b0-4ebe-a39b-37f35f365d67 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:03.066510 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-cdadbd77-14b0-4ebe-a39b-37f35f365d67 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:03.066927 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-cdadbd77-14b0-4ebe-a39b-37f35f365d67 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:03.067608 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-cdadbd77-14b0-4ebe-a39b-37f35f365d67 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:03.068093 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-cdadbd77-14b0-4ebe-a39b-37f35f365d67 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:03.068519 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-cdadbd77-14b0-4ebe-a39b-37f35f365d67 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:03.193791 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-cdadbd77-14b0-4ebe-a39b-37f35f365d67 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:03.201840 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-cdadbd77-14b0-4ebe-a39b-37f35f365d67 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5" status: 200 len: 1734 microversion: 2.1 time: 0.147388 Aug 11 11:08:03.202403 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 288/596] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:08:03 2022] GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5 => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:08:03.436847 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-02ba264d-395f-4b4f-900d-bb70f86887ec tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:08:03.437533 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-02ba264d-395f-4b4f-900d-bb70f86887ec tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:08:03.443585 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-02ba264d-395f-4b4f-900d-bb70f86887ec tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:03.444095 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-02ba264d-395f-4b4f-900d-bb70f86887ec tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:03.444527 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-02ba264d-395f-4b4f-900d-bb70f86887ec tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:03.445212 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-02ba264d-395f-4b4f-900d-bb70f86887ec tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:03.445660 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-02ba264d-395f-4b4f-900d-bb70f86887ec tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:03.446078 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-02ba264d-395f-4b4f-900d-bb70f86887ec tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:03.573567 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-02ba264d-395f-4b4f-900d-bb70f86887ec tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:03.580922 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-02ba264d-395f-4b4f-900d-bb70f86887ec tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1655 microversion: 2.1 time: 0.147901 Aug 11 11:08:03.581479 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 309/597] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:08:03 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1655 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:08:03.601507 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-00a4605a-ff2b-4f54-a448-c4671d0e1d36 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:08:03.608188 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-00a4605a-ff2b-4f54-a448-c4671d0e1d36 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:03.608666 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-00a4605a-ff2b-4f54-a448-c4671d0e1d36 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:03.609096 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-00a4605a-ff2b-4f54-a448-c4671d0e1d36 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:03.625109 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell1:SELECT=100 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:08:03.630669 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-00a4605a-ff2b-4f54-a448-c4671d0e1d36 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Going to try to start instance {{(pid=121231) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 11 11:08:03.807643 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-3345cef5-1be0-4efc-81e7-74142846e49f tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:08:03.808285 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-3345cef5-1be0-4efc-81e7-74142846e49f tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] [instance: 3794302e-1657-4edd-9e15-a78592597d5b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:08:03.814713 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3345cef5-1be0-4efc-81e7-74142846e49f tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:03.815231 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3345cef5-1be0-4efc-81e7-74142846e49f tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:03.815665 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3345cef5-1be0-4efc-81e7-74142846e49f tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:03.816371 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3345cef5-1be0-4efc-81e7-74142846e49f tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:03.816818 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3345cef5-1be0-4efc-81e7-74142846e49f tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:03.817236 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3345cef5-1be0-4efc-81e7-74142846e49f tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:03.832058 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-00a4605a-ff2b-4f54-a448-c4671d0e1d36 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "POST /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935/action" status: 202 len: 0 microversion: 2.1 time: 0.230787 Aug 11 11:08:03.832058 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 289/598] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Aug 11 11:08:03 2022] POST /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935/action => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 11:08:03.837676 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-3495283d-b18b-4d15-a5d1-dc614d7b1b36 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:08:03.838971 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-3495283d-b18b-4d15-a5d1-dc614d7b1b36 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:08:03.844980 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3495283d-b18b-4d15-a5d1-dc614d7b1b36 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:03.845459 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3495283d-b18b-4d15-a5d1-dc614d7b1b36 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:03.846051 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3495283d-b18b-4d15-a5d1-dc614d7b1b36 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:03.846578 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3495283d-b18b-4d15-a5d1-dc614d7b1b36 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:03.847030 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3495283d-b18b-4d15-a5d1-dc614d7b1b36 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:03.847453 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3495283d-b18b-4d15-a5d1-dc614d7b1b36 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:04.030334 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-3345cef5-1be0-4efc-81e7-74142846e49f tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfaf5a716c5b448f8e1274de2fad307c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233f1c55781b4099be6e250e664c4fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:04.032852 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-3495283d-b18b-4d15-a5d1-dc614d7b1b36 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:04.038678 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-3345cef5-1be0-4efc-81e7-74142846e49f tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] 10.222.0.48 "GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b" status: 200 len: 1756 microversion: 2.1 time: 0.234871 Aug 11 11:08:04.039502 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 310/599] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:08:03 2022] GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b => generated 1756 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:08:04.040783 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-3495283d-b18b-4d15-a5d1-dc614d7b1b36 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1664 microversion: 2.1 time: 0.207062 Aug 11 11:08:04.041568 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 290/600] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:08:03 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1664 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:08:04.222413 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-7913d34c-0b48-4a47-9c31-bb46803a67e5 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:08:04.223014 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-7913d34c-0b48-4a47-9c31-bb46803a67e5 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 481c1d02-4070-4d58-8be2-438cd1a68eb5] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:08:04.229454 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7913d34c-0b48-4a47-9c31-bb46803a67e5 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:04.229926 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7913d34c-0b48-4a47-9c31-bb46803a67e5 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:04.230355 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7913d34c-0b48-4a47-9c31-bb46803a67e5 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:04.231065 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7913d34c-0b48-4a47-9c31-bb46803a67e5 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:04.231472 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7913d34c-0b48-4a47-9c31-bb46803a67e5 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:04.231915 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7913d34c-0b48-4a47-9c31-bb46803a67e5 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:04.363299 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-7913d34c-0b48-4a47-9c31-bb46803a67e5 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:04.371818 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-7913d34c-0b48-4a47-9c31-bb46803a67e5 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5" status: 200 len: 1734 microversion: 2.1 time: 0.153162 Aug 11 11:08:04.372686 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 311/601] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:08:04 2022] GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:08:05.061021 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-3621528a-4d5e-4643-a57f-048f52ff9fdf tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:08:05.061610 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-763f88a4-9a0c-43a4-be3e-ff463233f57f tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:08:05.061981 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-3621528a-4d5e-4643-a57f-048f52ff9fdf tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] [instance: 3794302e-1657-4edd-9e15-a78592597d5b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:08:05.062077 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-763f88a4-9a0c-43a4-be3e-ff463233f57f tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:08:05.068673 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-763f88a4-9a0c-43a4-be3e-ff463233f57f tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:05.075361 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3621528a-4d5e-4643-a57f-048f52ff9fdf tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:05.075509 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-763f88a4-9a0c-43a4-be3e-ff463233f57f tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:05.075631 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3621528a-4d5e-4643-a57f-048f52ff9fdf tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:05.075731 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-763f88a4-9a0c-43a4-be3e-ff463233f57f tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:05.075850 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3621528a-4d5e-4643-a57f-048f52ff9fdf tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:05.075970 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-763f88a4-9a0c-43a4-be3e-ff463233f57f tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:05.076066 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3621528a-4d5e-4643-a57f-048f52ff9fdf tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:05.076154 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-763f88a4-9a0c-43a4-be3e-ff463233f57f tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:05.076233 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3621528a-4d5e-4643-a57f-048f52ff9fdf tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:05.076339 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-763f88a4-9a0c-43a4-be3e-ff463233f57f tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:05.076431 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3621528a-4d5e-4643-a57f-048f52ff9fdf tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:05.276153 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-763f88a4-9a0c-43a4-be3e-ff463233f57f tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:05.284216 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-763f88a4-9a0c-43a4-be3e-ff463233f57f tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1664 microversion: 2.1 time: 0.226451 Aug 11 11:08:05.285233 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 312/602] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:08:05 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1664 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:08:05.285581 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-3621528a-4d5e-4643-a57f-048f52ff9fdf tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfaf5a716c5b448f8e1274de2fad307c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233f1c55781b4099be6e250e664c4fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:05.294104 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-3621528a-4d5e-4643-a57f-048f52ff9fdf tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] 10.222.0.48 "GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b" status: 200 len: 1756 microversion: 2.1 time: 0.237012 Aug 11 11:08:05.294666 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 291/603] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:08:05 2022] GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b => generated 1756 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:08:05.393907 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-777e9243-166e-4094-a861-e0e07de8d5b0 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:08:05.394548 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-777e9243-166e-4094-a861-e0e07de8d5b0 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 481c1d02-4070-4d58-8be2-438cd1a68eb5] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:08:05.401098 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-777e9243-166e-4094-a861-e0e07de8d5b0 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:05.401583 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-777e9243-166e-4094-a861-e0e07de8d5b0 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:05.402020 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-777e9243-166e-4094-a861-e0e07de8d5b0 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:05.402702 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-777e9243-166e-4094-a861-e0e07de8d5b0 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:05.403155 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-777e9243-166e-4094-a861-e0e07de8d5b0 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:05.403581 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-777e9243-166e-4094-a861-e0e07de8d5b0 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:05.529989 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-777e9243-166e-4094-a861-e0e07de8d5b0 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:05.538217 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-777e9243-166e-4094-a861-e0e07de8d5b0 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5" status: 200 len: 1734 microversion: 2.1 time: 0.148233 Aug 11 11:08:05.539007 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 313/604] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:08:05 2022] GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:08:06.305573 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-5ed2fc7d-69ba-43a6-a23b-1e8c0bf82686 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:08:06.306209 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-5ed2fc7d-69ba-43a6-a23b-1e8c0bf82686 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:08:06.314760 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5ed2fc7d-69ba-43a6-a23b-1e8c0bf82686 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:06.314949 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-0295a55e-e931-4fd9-8bef-fa7f51fe5c07 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:08:06.315405 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5ed2fc7d-69ba-43a6-a23b-1e8c0bf82686 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:06.315644 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-0295a55e-e931-4fd9-8bef-fa7f51fe5c07 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] [instance: 3794302e-1657-4edd-9e15-a78592597d5b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:08:06.315787 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5ed2fc7d-69ba-43a6-a23b-1e8c0bf82686 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:06.316385 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5ed2fc7d-69ba-43a6-a23b-1e8c0bf82686 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:06.316837 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5ed2fc7d-69ba-43a6-a23b-1e8c0bf82686 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:06.317259 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5ed2fc7d-69ba-43a6-a23b-1e8c0bf82686 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:06.322436 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0295a55e-e931-4fd9-8bef-fa7f51fe5c07 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:06.322919 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0295a55e-e931-4fd9-8bef-fa7f51fe5c07 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:06.323354 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0295a55e-e931-4fd9-8bef-fa7f51fe5c07 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:06.324084 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0295a55e-e931-4fd9-8bef-fa7f51fe5c07 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:06.324571 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0295a55e-e931-4fd9-8bef-fa7f51fe5c07 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:06.324963 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0295a55e-e931-4fd9-8bef-fa7f51fe5c07 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:06.527524 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-5ed2fc7d-69ba-43a6-a23b-1e8c0bf82686 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:06.535135 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-5ed2fc7d-69ba-43a6-a23b-1e8c0bf82686 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1664 microversion: 2.1 time: 0.233454 Aug 11 11:08:06.535793 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 292/605] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:08:06 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1664 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:08:06.543535 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-0295a55e-e931-4fd9-8bef-fa7f51fe5c07 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfaf5a716c5b448f8e1274de2fad307c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233f1c55781b4099be6e250e664c4fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:06.551826 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-0295a55e-e931-4fd9-8bef-fa7f51fe5c07 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] 10.222.0.48 "GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b" status: 200 len: 1756 microversion: 2.1 time: 0.240696 Aug 11 11:08:06.552383 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 314/606] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:08:06 2022] GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b => generated 1756 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:08:06.559561 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-a8745196-8620-40f2-8f48-fbb1cfe76964 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:08:06.560159 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-a8745196-8620-40f2-8f48-fbb1cfe76964 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 481c1d02-4070-4d58-8be2-438cd1a68eb5] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:08:06.566271 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a8745196-8620-40f2-8f48-fbb1cfe76964 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:06.566770 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a8745196-8620-40f2-8f48-fbb1cfe76964 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:06.567187 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a8745196-8620-40f2-8f48-fbb1cfe76964 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:06.567894 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a8745196-8620-40f2-8f48-fbb1cfe76964 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:06.568349 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a8745196-8620-40f2-8f48-fbb1cfe76964 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:06.568777 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a8745196-8620-40f2-8f48-fbb1cfe76964 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:06.700937 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-a8745196-8620-40f2-8f48-fbb1cfe76964 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:06.709148 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-a8745196-8620-40f2-8f48-fbb1cfe76964 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5" status: 200 len: 1714 microversion: 2.1 time: 0.153563 Aug 11 11:08:06.709717 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 293/607] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:08:06 2022] GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5 => generated 1714 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:08:06.814983 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-2aa80c99-7492-41e3-a97a-f7eaa5ad17fd tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:08:06.815509 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-2aa80c99-7492-41e3-a97a-f7eaa5ad17fd tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 481c1d02-4070-4d58-8be2-438cd1a68eb5] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:08:06.821377 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2aa80c99-7492-41e3-a97a-f7eaa5ad17fd tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:06.821852 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2aa80c99-7492-41e3-a97a-f7eaa5ad17fd tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:06.822794 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2aa80c99-7492-41e3-a97a-f7eaa5ad17fd tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:06.823473 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2aa80c99-7492-41e3-a97a-f7eaa5ad17fd tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:06.823949 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2aa80c99-7492-41e3-a97a-f7eaa5ad17fd tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:06.840485 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2aa80c99-7492-41e3-a97a-f7eaa5ad17fd tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:06.858560 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-773e37a7-b0fe-47b3-ad89-b77eb7d8f4eb tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:08:06.859041 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-773e37a7-b0fe-47b3-ad89-b77eb7d8f4eb tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] [instance: ff5a8410-e497-415f-be25-4a20e3345698] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:08:06.865103 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-773e37a7-b0fe-47b3-ad89-b77eb7d8f4eb tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:06.865581 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-773e37a7-b0fe-47b3-ad89-b77eb7d8f4eb tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:06.866006 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-773e37a7-b0fe-47b3-ad89-b77eb7d8f4eb tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:06.866688 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-773e37a7-b0fe-47b3-ad89-b77eb7d8f4eb tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:06.867132 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-773e37a7-b0fe-47b3-ad89-b77eb7d8f4eb tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:06.867549 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-773e37a7-b0fe-47b3-ad89-b77eb7d8f4eb tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:06.884382 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=100 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:08:06.950771 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.wsgi [None req-2aa80c99-7492-41e3-a97a-f7eaa5ad17fd tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] HTTP exception thrown: Cannot 'detach_volume' instance 481c1d02-4070-4d58-8be2-438cd1a68eb5 while it is in vm_state rescued Aug 11 11:08:06.952415 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-2aa80c99-7492-41e3-a97a-f7eaa5ad17fd tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Request method failure captured: Aug 11 11:08:06.952415 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: request: DELETE /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5/os-volume_attachments/ee369e49-b9bc-4046-b528-2b78a44b8f4e HTTP/1.1 Aug 11 11:08:06.952415 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Accept: application/json Aug 11 11:08:06.952415 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Accept-Encoding: identity Aug 11 11:08:06.952415 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Connection: close Aug 11 11:08:06.952415 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Content-Length: 0 Aug 11 11:08:06.952415 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Content-Type: application/json Aug 11 11:08:06.952415 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Host: 10.222.0.48 Aug 11 11:08:06.952415 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Openstack-System-Scope: None Aug 11 11:08:06.952415 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: User-Agent: python-urllib3/1.26.11 Aug 11 11:08:06.952415 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Auth-Token: gAAAAABi9OIZrQLD9wcn33oOAILRLRgizejVjH27hxki3e7YaqpWc9w5AB6twcQbo6ujH2ticAWA98YJt2oEA_0zpX3GqgJkSqqHfHltxhU9T4SgJ_YQxUiy9cMGURf0wSoT5Vg71mc-C9U7FKhPy_DOheOZskafHmoddANNVZO-sZBS_1qYvI4 Aug 11 11:08:06.952415 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Domain-Id: None Aug 11 11:08:06.952415 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Domain-Name: None Aug 11 11:08:06.952415 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Identity-Status: Confirmed Aug 11 11:08:06.952415 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Is-Admin-Project: True Aug 11 11:08:06.952415 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Domain-Id: default Aug 11 11:08:06.952415 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Domain-Name: Default Aug 11 11:08:06.952415 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Id: e8751d4bd74240db9b57b7e9f788df94 Aug 11 11:08:06.952415 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1157402601 Aug 11 11:08:06.952415 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Role: reader,member Aug 11 11:08:06.952415 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Roles: reader,member Aug 11 11:08:06.954220 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e8751d4bd74240db9b57b7e9f788df94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e8751d4bd74240db9b57b7e9f788df94"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e8751d4bd74240db9b57b7e9f788df94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e8751d4bd74240db9b57b7e9f788df94", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] Aug 11 11:08:06.954220 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1157402601 Aug 11 11:08:06.954220 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Tenant-Id: e8751d4bd74240db9b57b7e9f788df94 Aug 11 11:08:06.954220 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1157402601 Aug 11 11:08:06.954220 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User: tempest-ServerRescueNegativeTestJSON-1157402601-project Aug 11 11:08:06.954220 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Domain-Id: default Aug 11 11:08:06.954220 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Domain-Name: Default Aug 11 11:08:06.954220 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Id: 684d59041e82466d8aad6d2964842bf5 Aug 11 11:08:06.954220 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1157402601-project Aug 11 11:08:06.954220 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: method: > Aug 11 11:08:06.954220 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: exception: Cannot 'detach_volume' instance 481c1d02-4070-4d58-8be2-438cd1a68eb5 while it is in vm_state rescued Aug 11 11:08:06.955044 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: action_args: {'server_id': '481c1d02-4070-4d58-8be2-438cd1a68eb5', 'id': 'ee369e49-b9bc-4046-b528-2b78a44b8f4e'} Aug 11 11:08:06.955044 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 11:08:06.955044 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:08:06.955044 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 11 11:08:06.955044 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 11 11:08:06.955044 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 11 11:08:06.955044 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 11 11:08:06.955044 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 11 11:08:06.955044 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 11 11:08:06.955044 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 481c1d02-4070-4d58-8be2-438cd1a68eb5 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 11 11:08:06.955044 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:08:06.955044 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:08:06.955044 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:08:06.955044 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:08:06.955044 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:08:06.955044 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:08:06.955044 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 11:08:06.955044 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 11:08:06.955044 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 11:08:06.955044 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 11:08:06.956678 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 11 11:08:06.956678 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 11 11:08:06.956678 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 11 11:08:06.956678 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 11 11:08:06.956678 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 481c1d02-4070-4d58-8be2-438cd1a68eb5 while it is in vm_state rescued Aug 11 11:08:06.956678 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:08:06.956678 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:08:06.956678 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:08:06.956678 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:08:06.956678 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:08:06.956678 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:08:06.956678 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 11:08:06.956678 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 11:08:06.956678 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 481c1d02-4070-4d58-8be2-438cd1a68eb5 while it is in vm_state rescued Aug 11 11:08:06.956678 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:08:06.956678 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-2aa80c99-7492-41e3-a97a-f7eaa5ad17fd tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Returning 409 to user: Cannot 'detach_volume' instance 481c1d02-4070-4d58-8be2-438cd1a68eb5 while it is in vm_state rescued {{(pid=121232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 11:08:06.957650 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-2aa80c99-7492-41e3-a97a-f7eaa5ad17fd tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "DELETE /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5/os-volume_attachments/ee369e49-b9bc-4046-b528-2b78a44b8f4e" status: 409 len: 152 microversion: 2.1 time: 0.144092 Aug 11 11:08:06.957747 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.objects.instance [None req-773e37a7-b0fe-47b3-ad89-b77eb7d8f4eb tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lazy-loading 'services' on Instance uuid ff5a8410-e497-415f-be25-4a20e3345698 {{(pid=121231) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 11:08:06.957846 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 315/608] 10.222.0.48 () {58 vars in 1416 bytes} [Thu Aug 11 11:08:06 2022] DELETE /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5/os-volume_attachments/ee369e49-b9bc-4046-b528-2b78a44b8f4e => generated 152 bytes in 145 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 11 11:08:06.965576 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-5d158709-5f66-4bb6-9a66-fd5f52d52dd1 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:08:06.966112 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-5d158709-5f66-4bb6-9a66-fd5f52d52dd1 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 481c1d02-4070-4d58-8be2-438cd1a68eb5] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:08:06.973023 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5d158709-5f66-4bb6-9a66-fd5f52d52dd1 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:06.973505 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5d158709-5f66-4bb6-9a66-fd5f52d52dd1 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:06.973936 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5d158709-5f66-4bb6-9a66-fd5f52d52dd1 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:06.974627 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5d158709-5f66-4bb6-9a66-fd5f52d52dd1 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:06.975077 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5d158709-5f66-4bb6-9a66-fd5f52d52dd1 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:06.975497 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5d158709-5f66-4bb6-9a66-fd5f52d52dd1 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:07.236290 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-773e37a7-b0fe-47b3-ad89-b77eb7d8f4eb tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] 10.222.0.48 "DELETE /compute/v2.1/servers/ff5a8410-e497-415f-be25-4a20e3345698/os-volume_attachments/efe574cb-1758-4a09-b77a-bc90aa300a9c" status: 202 len: 0 microversion: 2.1 time: 0.381596 Aug 11 11:08:07.236920 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 294/609] 10.222.0.48 () {58 vars in 1416 bytes} [Thu Aug 11 11:08:06 2022] DELETE /compute/v2.1/servers/ff5a8410-e497-415f-be25-4a20e3345698/os-volume_attachments/efe574cb-1758-4a09-b77a-bc90aa300a9c => generated 0 bytes in 384 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 11:08:07.274085 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-5d158709-5f66-4bb6-9a66-fd5f52d52dd1 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "POST /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5/action" status: 202 len: 0 microversion: 2.1 time: 0.312090 Aug 11 11:08:07.275235 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 316/610] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Aug 11 11:08:06 2022] POST /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5/action => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 11 11:08:07.283674 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-b8349fcc-56fe-46af-8aa1-8b54436d2238 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:08:07.284424 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-b8349fcc-56fe-46af-8aa1-8b54436d2238 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 481c1d02-4070-4d58-8be2-438cd1a68eb5] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:08:07.290684 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b8349fcc-56fe-46af-8aa1-8b54436d2238 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:07.291205 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b8349fcc-56fe-46af-8aa1-8b54436d2238 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:07.292268 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b8349fcc-56fe-46af-8aa1-8b54436d2238 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:07.292951 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b8349fcc-56fe-46af-8aa1-8b54436d2238 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:07.293394 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b8349fcc-56fe-46af-8aa1-8b54436d2238 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:07.293810 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b8349fcc-56fe-46af-8aa1-8b54436d2238 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:07.427398 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-b8349fcc-56fe-46af-8aa1-8b54436d2238 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:07.435385 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-b8349fcc-56fe-46af-8aa1-8b54436d2238 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5" status: 200 len: 1722 microversion: 2.1 time: 0.155796 Aug 11 11:08:07.435948 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 295/611] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:08:07 2022] GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:08:07.557955 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-0349e1bf-b454-4108-9ea4-679561614e18 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:08:07.558728 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-0349e1bf-b454-4108-9ea4-679561614e18 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:08:07.564875 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0349e1bf-b454-4108-9ea4-679561614e18 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:07.565387 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0349e1bf-b454-4108-9ea4-679561614e18 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:07.565823 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0349e1bf-b454-4108-9ea4-679561614e18 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:07.566529 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0349e1bf-b454-4108-9ea4-679561614e18 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:07.567544 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0349e1bf-b454-4108-9ea4-679561614e18 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:07.568009 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0349e1bf-b454-4108-9ea4-679561614e18 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:07.573623 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-82f541a6-05da-4283-b10f-516fc31d924d tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:08:07.574253 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-82f541a6-05da-4283-b10f-516fc31d924d tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] [instance: 3794302e-1657-4edd-9e15-a78592597d5b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:08:07.580267 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-82f541a6-05da-4283-b10f-516fc31d924d tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:07.580928 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-82f541a6-05da-4283-b10f-516fc31d924d tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:07.581365 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-82f541a6-05da-4283-b10f-516fc31d924d tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:07.582221 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-82f541a6-05da-4283-b10f-516fc31d924d tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:07.582673 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-82f541a6-05da-4283-b10f-516fc31d924d tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:07.583094 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-82f541a6-05da-4283-b10f-516fc31d924d tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:07.783688 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-0349e1bf-b454-4108-9ea4-679561614e18 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:07.791636 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-0349e1bf-b454-4108-9ea4-679561614e18 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1664 microversion: 2.1 time: 0.238346 Aug 11 11:08:07.792343 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 317/612] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:08:07 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1664 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:08:07.797680 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-82f541a6-05da-4283-b10f-516fc31d924d tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfaf5a716c5b448f8e1274de2fad307c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233f1c55781b4099be6e250e664c4fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:07.806690 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-82f541a6-05da-4283-b10f-516fc31d924d tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] 10.222.0.48 "GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b" status: 200 len: 1756 microversion: 2.1 time: 0.237333 Aug 11 11:08:07.807371 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 296/613] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:08:07 2022] GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b => generated 1756 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:08:08.456590 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-776bd554-ca89-414d-b87e-b5a9c81f70d0 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:08:08.457277 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-776bd554-ca89-414d-b87e-b5a9c81f70d0 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 481c1d02-4070-4d58-8be2-438cd1a68eb5] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:08:08.463468 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-776bd554-ca89-414d-b87e-b5a9c81f70d0 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:08.463997 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-776bd554-ca89-414d-b87e-b5a9c81f70d0 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:08.464541 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-776bd554-ca89-414d-b87e-b5a9c81f70d0 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:08.465332 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-776bd554-ca89-414d-b87e-b5a9c81f70d0 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:08.465833 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-776bd554-ca89-414d-b87e-b5a9c81f70d0 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:08.466324 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-776bd554-ca89-414d-b87e-b5a9c81f70d0 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:08.600656 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-776bd554-ca89-414d-b87e-b5a9c81f70d0 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:08.609437 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-776bd554-ca89-414d-b87e-b5a9c81f70d0 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5" status: 200 len: 1722 microversion: 2.1 time: 0.156821 Aug 11 11:08:08.610005 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 318/614] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:08:08 2022] GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:08:08.812102 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-fecef7f1-2727-45b2-af9c-7d1faffb1e14 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:08:08.812736 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-fecef7f1-2727-45b2-af9c-7d1faffb1e14 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:08:08.819496 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fecef7f1-2727-45b2-af9c-7d1faffb1e14 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:08.820014 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fecef7f1-2727-45b2-af9c-7d1faffb1e14 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:08.820448 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fecef7f1-2727-45b2-af9c-7d1faffb1e14 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:08.821142 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fecef7f1-2727-45b2-af9c-7d1faffb1e14 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:08.821593 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fecef7f1-2727-45b2-af9c-7d1faffb1e14 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:08.822011 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fecef7f1-2727-45b2-af9c-7d1faffb1e14 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:08.828150 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-d1a104eb-830d-403e-b8fd-eeecf286447f tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:08:08.828862 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-d1a104eb-830d-403e-b8fd-eeecf286447f tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] [instance: 3794302e-1657-4edd-9e15-a78592597d5b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:08:08.834965 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d1a104eb-830d-403e-b8fd-eeecf286447f tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:08.835518 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d1a104eb-830d-403e-b8fd-eeecf286447f tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:08.835981 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d1a104eb-830d-403e-b8fd-eeecf286447f tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:08.836668 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d1a104eb-830d-403e-b8fd-eeecf286447f tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:08.837259 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d1a104eb-830d-403e-b8fd-eeecf286447f tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:08.837693 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d1a104eb-830d-403e-b8fd-eeecf286447f tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:09.031946 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-fecef7f1-2727-45b2-af9c-7d1faffb1e14 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:09.039827 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-fecef7f1-2727-45b2-af9c-7d1faffb1e14 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1668 microversion: 2.1 time: 0.231596 Aug 11 11:08:09.040442 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 297/615] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:08:08 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1668 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:08:09.048744 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d1a104eb-830d-403e-b8fd-eeecf286447f tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfaf5a716c5b448f8e1274de2fad307c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233f1c55781b4099be6e250e664c4fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:09.056799 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-d1a104eb-830d-403e-b8fd-eeecf286447f tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] 10.222.0.48 "GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b" status: 200 len: 1756 microversion: 2.1 time: 0.232763 Aug 11 11:08:09.057400 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 319/616] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:08:08 2022] GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b => generated 1756 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:08:09.422992 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-11c7771a-1931-4d0f-871b-ef829ee72b42 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:08:09.423485 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-11c7771a-1931-4d0f-871b-ef829ee72b42 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] [instance: ff5a8410-e497-415f-be25-4a20e3345698] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:08:09.429487 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-11c7771a-1931-4d0f-871b-ef829ee72b42 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:09.429971 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-11c7771a-1931-4d0f-871b-ef829ee72b42 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:09.430407 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-11c7771a-1931-4d0f-871b-ef829ee72b42 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:09.431106 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-11c7771a-1931-4d0f-871b-ef829ee72b42 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:09.431543 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-11c7771a-1931-4d0f-871b-ef829ee72b42 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:09.431994 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-11c7771a-1931-4d0f-871b-ef829ee72b42 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:09.456817 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-11c7771a-1931-4d0f-871b-ef829ee72b42 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] [instance: ff5a8410-e497-415f-be25-4a20e3345698] Going to try to terminate instance {{(pid=121231) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 11 11:08:09.630999 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-803138b6-2f0b-4681-aa9c-2b3703e7f8f5 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:08:09.631545 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-803138b6-2f0b-4681-aa9c-2b3703e7f8f5 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 481c1d02-4070-4d58-8be2-438cd1a68eb5] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:08:09.638576 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-803138b6-2f0b-4681-aa9c-2b3703e7f8f5 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:09.639052 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-803138b6-2f0b-4681-aa9c-2b3703e7f8f5 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:09.639482 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-803138b6-2f0b-4681-aa9c-2b3703e7f8f5 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:09.640175 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-803138b6-2f0b-4681-aa9c-2b3703e7f8f5 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:09.640617 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-803138b6-2f0b-4681-aa9c-2b3703e7f8f5 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:09.641030 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-803138b6-2f0b-4681-aa9c-2b3703e7f8f5 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:09.732993 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-11c7771a-1931-4d0f-871b-ef829ee72b42 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] 10.222.0.48 "DELETE /compute/v2.1/servers/ff5a8410-e497-415f-be25-4a20e3345698" status: 204 len: 0 microversion: 2.1 time: 0.313753 Aug 11 11:08:09.733581 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 298/617] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Aug 11 11:08:09 2022] DELETE /compute/v2.1/servers/ff5a8410-e497-415f-be25-4a20e3345698 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 11 11:08:09.742246 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-c0b4d3f6-d55e-4f2b-8f75-22c751c18e3d tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:08:09.742936 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-c0b4d3f6-d55e-4f2b-8f75-22c751c18e3d tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] [instance: ff5a8410-e497-415f-be25-4a20e3345698] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:08:09.749429 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c0b4d3f6-d55e-4f2b-8f75-22c751c18e3d tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:09.749906 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c0b4d3f6-d55e-4f2b-8f75-22c751c18e3d tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:09.750332 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c0b4d3f6-d55e-4f2b-8f75-22c751c18e3d tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:09.751008 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c0b4d3f6-d55e-4f2b-8f75-22c751c18e3d tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:09.751712 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c0b4d3f6-d55e-4f2b-8f75-22c751c18e3d tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:09.752178 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c0b4d3f6-d55e-4f2b-8f75-22c751c18e3d tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:09.772724 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-803138b6-2f0b-4681-aa9c-2b3703e7f8f5 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:09.780784 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-803138b6-2f0b-4681-aa9c-2b3703e7f8f5 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5" status: 200 len: 1722 microversion: 2.1 time: 0.153857 Aug 11 11:08:09.781441 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 320/618] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:08:09 2022] GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:08:09.884528 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-c0b4d3f6-d55e-4f2b-8f75-22c751c18e3d tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7493d38d24493b3298ac37592ecd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c8a1db00944c59950120c030ab47e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:09.892457 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-c0b4d3f6-d55e-4f2b-8f75-22c751c18e3d tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] 10.222.0.48 "GET /compute/v2.1/servers/ff5a8410-e497-415f-be25-4a20e3345698" status: 200 len: 1561 microversion: 2.1 time: 0.154465 Aug 11 11:08:09.893033 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 299/619] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:08:09 2022] GET /compute/v2.1/servers/ff5a8410-e497-415f-be25-4a20e3345698 => generated 1561 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:08:10.078012 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-3a57574c-df85-4617-8679-5a1909a36445 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:08:10.078615 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-3a57574c-df85-4617-8679-5a1909a36445 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] [instance: 3794302e-1657-4edd-9e15-a78592597d5b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:08:10.084563 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3a57574c-df85-4617-8679-5a1909a36445 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:10.085041 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3a57574c-df85-4617-8679-5a1909a36445 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:10.085500 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3a57574c-df85-4617-8679-5a1909a36445 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:10.086190 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3a57574c-df85-4617-8679-5a1909a36445 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:10.086637 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3a57574c-df85-4617-8679-5a1909a36445 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:10.087057 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3a57574c-df85-4617-8679-5a1909a36445 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:10.225659 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-3a57574c-df85-4617-8679-5a1909a36445 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfaf5a716c5b448f8e1274de2fad307c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233f1c55781b4099be6e250e664c4fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:10.234643 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-3a57574c-df85-4617-8679-5a1909a36445 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] 10.222.0.48 "GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b" status: 200 len: 1756 microversion: 2.1 time: 0.160599 Aug 11 11:08:10.235209 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 321/620] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:08:10 2022] GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:08:10.802279 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-588a33d9-c89d-464e-86d1-90957789add3 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:08:10.802872 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-588a33d9-c89d-464e-86d1-90957789add3 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 481c1d02-4070-4d58-8be2-438cd1a68eb5] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:08:10.808894 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-588a33d9-c89d-464e-86d1-90957789add3 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:10.809372 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-588a33d9-c89d-464e-86d1-90957789add3 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:10.809798 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-588a33d9-c89d-464e-86d1-90957789add3 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:10.810473 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-588a33d9-c89d-464e-86d1-90957789add3 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:10.810918 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-588a33d9-c89d-464e-86d1-90957789add3 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:10.811336 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-588a33d9-c89d-464e-86d1-90957789add3 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:10.914169 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-2b39c975-1e1d-4a0a-b657-1f2897e09e0b tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:08:10.914999 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-2b39c975-1e1d-4a0a-b657-1f2897e09e0b tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] [instance: ff5a8410-e497-415f-be25-4a20e3345698] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:08:10.923186 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2b39c975-1e1d-4a0a-b657-1f2897e09e0b tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:10.923794 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2b39c975-1e1d-4a0a-b657-1f2897e09e0b tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:10.924404 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2b39c975-1e1d-4a0a-b657-1f2897e09e0b tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:10.925365 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2b39c975-1e1d-4a0a-b657-1f2897e09e0b tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:10.925890 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2b39c975-1e1d-4a0a-b657-1f2897e09e0b tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:10.926408 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2b39c975-1e1d-4a0a-b657-1f2897e09e0b tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:10.950647 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-588a33d9-c89d-464e-86d1-90957789add3 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:10.961057 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-588a33d9-c89d-464e-86d1-90957789add3 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5" status: 200 len: 1722 microversion: 2.1 time: 0.162498 Aug 11 11:08:10.991650 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 300/621] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:08:10 2022] GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:08:11.067578 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-2b39c975-1e1d-4a0a-b657-1f2897e09e0b tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7493d38d24493b3298ac37592ecd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c8a1db00944c59950120c030ab47e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:11.075594 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-2b39c975-1e1d-4a0a-b657-1f2897e09e0b tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] 10.222.0.48 "GET /compute/v2.1/servers/ff5a8410-e497-415f-be25-4a20e3345698" status: 200 len: 1515 microversion: 2.1 time: 0.166232 Aug 11 11:08:11.076200 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 322/622] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:08:10 2022] GET /compute/v2.1/servers/ff5a8410-e497-415f-be25-4a20e3345698 => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:08:11.256131 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-65fa3d7f-7e64-4c00-96e8-f759a6a14b3f tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:08:11.256763 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-65fa3d7f-7e64-4c00-96e8-f759a6a14b3f tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] [instance: 3794302e-1657-4edd-9e15-a78592597d5b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:08:11.263306 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-65fa3d7f-7e64-4c00-96e8-f759a6a14b3f tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:11.263807 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-65fa3d7f-7e64-4c00-96e8-f759a6a14b3f tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:11.264245 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-65fa3d7f-7e64-4c00-96e8-f759a6a14b3f tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:11.264930 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-65fa3d7f-7e64-4c00-96e8-f759a6a14b3f tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:11.265382 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-65fa3d7f-7e64-4c00-96e8-f759a6a14b3f tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:11.265807 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-65fa3d7f-7e64-4c00-96e8-f759a6a14b3f tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:11.409386 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-65fa3d7f-7e64-4c00-96e8-f759a6a14b3f tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfaf5a716c5b448f8e1274de2fad307c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233f1c55781b4099be6e250e664c4fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:11.417796 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-65fa3d7f-7e64-4c00-96e8-f759a6a14b3f tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] 10.222.0.48 "GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b" status: 200 len: 1756 microversion: 2.1 time: 0.165490 Aug 11 11:08:11.418354 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 301/623] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:08:11 2022] GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:08:12.005614 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-b76e96c3-2409-4440-a524-b7944d277990 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:08:12.006214 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-b76e96c3-2409-4440-a524-b7944d277990 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 481c1d02-4070-4d58-8be2-438cd1a68eb5] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:08:12.012901 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b76e96c3-2409-4440-a524-b7944d277990 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:12.013380 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b76e96c3-2409-4440-a524-b7944d277990 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:12.013807 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b76e96c3-2409-4440-a524-b7944d277990 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:12.014509 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b76e96c3-2409-4440-a524-b7944d277990 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:12.014954 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b76e96c3-2409-4440-a524-b7944d277990 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:12.015367 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b76e96c3-2409-4440-a524-b7944d277990 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:12.096203 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-9786b998-bdd1-4059-a6c2-7fdc6764da28 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:08:12.096801 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-9786b998-bdd1-4059-a6c2-7fdc6764da28 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] [instance: ff5a8410-e497-415f-be25-4a20e3345698] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:08:12.103272 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9786b998-bdd1-4059-a6c2-7fdc6764da28 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:12.103747 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9786b998-bdd1-4059-a6c2-7fdc6764da28 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:12.104207 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9786b998-bdd1-4059-a6c2-7fdc6764da28 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:12.104942 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9786b998-bdd1-4059-a6c2-7fdc6764da28 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:12.105390 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9786b998-bdd1-4059-a6c2-7fdc6764da28 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:12.105808 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9786b998-bdd1-4059-a6c2-7fdc6764da28 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:12.141544 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-b76e96c3-2409-4440-a524-b7944d277990 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:12.149668 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-b76e96c3-2409-4440-a524-b7944d277990 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5" status: 200 len: 1728 microversion: 2.1 time: 0.147899 Aug 11 11:08:12.150244 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 323/624] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:08:12 2022] GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5 => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:08:12.170178 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-199f5dde-03d0-46ac-9311-60ed3315e286 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:08:12.170690 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-199f5dde-03d0-46ac-9311-60ed3315e286 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 481c1d02-4070-4d58-8be2-438cd1a68eb5] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:08:12.177149 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-199f5dde-03d0-46ac-9311-60ed3315e286 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:12.177630 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-199f5dde-03d0-46ac-9311-60ed3315e286 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:12.178054 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-199f5dde-03d0-46ac-9311-60ed3315e286 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:12.178738 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-199f5dde-03d0-46ac-9311-60ed3315e286 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:12.179181 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-199f5dde-03d0-46ac-9311-60ed3315e286 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:12.179606 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-199f5dde-03d0-46ac-9311-60ed3315e286 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:12.270388 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-9786b998-bdd1-4059-a6c2-7fdc6764da28 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7493d38d24493b3298ac37592ecd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c8a1db00944c59950120c030ab47e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:12.274207 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:08:12.277415 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-199f5dde-03d0-46ac-9311-60ed3315e286 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.111126 Aug 11 11:08:12.278013 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 324/625] 10.222.0.48 () {58 vars in 1275 bytes} [Thu Aug 11 11:08:12 2022] GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5/os-interface => generated 284 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 11:08:12.279308 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-9786b998-bdd1-4059-a6c2-7fdc6764da28 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] 10.222.0.48 "GET /compute/v2.1/servers/ff5a8410-e497-415f-be25-4a20e3345698" status: 200 len: 1515 microversion: 2.1 time: 0.186854 Aug 11 11:08:12.279885 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 302/626] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:08:12 2022] GET /compute/v2.1/servers/ff5a8410-e497-415f-be25-4a20e3345698 => generated 1515 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:08:12.439672 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-da28c4bb-83f2-4bdc-8d37-e939fb38c366 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:08:12.440638 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-da28c4bb-83f2-4bdc-8d37-e939fb38c366 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] [instance: 3794302e-1657-4edd-9e15-a78592597d5b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:08:12.448750 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-da28c4bb-83f2-4bdc-8d37-e939fb38c366 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:12.450077 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-da28c4bb-83f2-4bdc-8d37-e939fb38c366 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:12.450967 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-da28c4bb-83f2-4bdc-8d37-e939fb38c366 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:12.451456 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-da28c4bb-83f2-4bdc-8d37-e939fb38c366 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:12.451949 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-da28c4bb-83f2-4bdc-8d37-e939fb38c366 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:12.456029 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-da28c4bb-83f2-4bdc-8d37-e939fb38c366 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:12.717721 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-da28c4bb-83f2-4bdc-8d37-e939fb38c366 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfaf5a716c5b448f8e1274de2fad307c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233f1c55781b4099be6e250e664c4fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:12.725766 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-da28c4bb-83f2-4bdc-8d37-e939fb38c366 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] 10.222.0.48 "GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b" status: 200 len: 1756 microversion: 2.1 time: 0.290018 Aug 11 11:08:12.726344 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 325/627] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:08:12 2022] GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b => generated 1756 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:08:13.301999 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-09cbf2e4-9092-4f09-b317-9f31f7a874de tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:08:13.303302 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-09cbf2e4-9092-4f09-b317-9f31f7a874de tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] [instance: ff5a8410-e497-415f-be25-4a20e3345698] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:08:13.310920 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-09cbf2e4-9092-4f09-b317-9f31f7a874de tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:13.311404 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-09cbf2e4-9092-4f09-b317-9f31f7a874de tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:13.312055 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-09cbf2e4-9092-4f09-b317-9f31f7a874de tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:13.312992 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-09cbf2e4-9092-4f09-b317-9f31f7a874de tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:13.313450 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-09cbf2e4-9092-4f09-b317-9f31f7a874de tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:13.313872 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-09cbf2e4-9092-4f09-b317-9f31f7a874de tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:13.747461 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-63d0f66b-ea44-4e61-b688-2dcb06ccd1b9 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:08:13.748199 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-63d0f66b-ea44-4e61-b688-2dcb06ccd1b9 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] [instance: 3794302e-1657-4edd-9e15-a78592597d5b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:08:13.755299 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-63d0f66b-ea44-4e61-b688-2dcb06ccd1b9 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:13.755900 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-63d0f66b-ea44-4e61-b688-2dcb06ccd1b9 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:13.756419 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-63d0f66b-ea44-4e61-b688-2dcb06ccd1b9 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:13.757191 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-63d0f66b-ea44-4e61-b688-2dcb06ccd1b9 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:13.757767 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-63d0f66b-ea44-4e61-b688-2dcb06ccd1b9 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:13.758355 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-63d0f66b-ea44-4e61-b688-2dcb06ccd1b9 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:13.761383 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-09cbf2e4-9092-4f09-b317-9f31f7a874de tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7493d38d24493b3298ac37592ecd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c8a1db00944c59950120c030ab47e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:13.772064 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-09cbf2e4-9092-4f09-b317-9f31f7a874de tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] 10.222.0.48 "GET /compute/v2.1/servers/ff5a8410-e497-415f-be25-4a20e3345698" status: 200 len: 1515 microversion: 2.1 time: 0.474159 Aug 11 11:08:13.785071 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 303/628] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:08:13 2022] GET /compute/v2.1/servers/ff5a8410-e497-415f-be25-4a20e3345698 => generated 1515 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:08:13.788062 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-9b0ca480-6a78-4bc7-b08d-05db945760f9 req-76166406-b773-4c15-b075-9689df42b36b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "481c1d02-4070-4d58-8be2-438cd1a68eb5", "tag": "9c6e465a-0bd3-4725-9e9b-81120495670d"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:08:13.805277 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-9b0ca480-6a78-4bc7-b08d-05db945760f9 req-76166406-b773-4c15-b075-9689df42b36b service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:13.806180 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-9b0ca480-6a78-4bc7-b08d-05db945760f9 req-76166406-b773-4c15-b075-9689df42b36b service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:13.806786 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-9b0ca480-6a78-4bc7-b08d-05db945760f9 req-76166406-b773-4c15-b075-9689df42b36b service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:13.824825 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-9b0ca480-6a78-4bc7-b08d-05db945760f9 req-76166406-b773-4c15-b075-9689df42b36b service nova] Creating event network-changed:9c6e465a-0bd3-4725-9e9b-81120495670d for instance 481c1d02-4070-4d58-8be2-438cd1a68eb5 on hv-cinder-82002 Aug 11 11:08:13.831081 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-9b0ca480-6a78-4bc7-b08d-05db945760f9 req-76166406-b773-4c15-b075-9689df42b36b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048570 Aug 11 11:08:13.831924 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 304/629] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:08:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:08:13.937295 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-63d0f66b-ea44-4e61-b688-2dcb06ccd1b9 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfaf5a716c5b448f8e1274de2fad307c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233f1c55781b4099be6e250e664c4fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:13.946598 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-63d0f66b-ea44-4e61-b688-2dcb06ccd1b9 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] 10.222.0.48 "GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b" status: 200 len: 1759 microversion: 2.1 time: 0.203785 Aug 11 11:08:13.947529 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 326/630] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:08:13 2022] GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b => generated 1759 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:08:14.769983 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-4982cbde-fff8-46be-915d-2723a09b1814 req-3e510513-441b-4df3-9845-7cb3b7ecc6ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff5a8410-e497-415f-be25-4a20e3345698", "name": "network-vif-deleted", "tag": "8972ea33-9084-424f-ba1b-37260a6e9da8"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:08:14.785086 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-4982cbde-fff8-46be-915d-2723a09b1814 req-3e510513-441b-4df3-9845-7cb3b7ecc6ee service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:14.785086 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-4982cbde-fff8-46be-915d-2723a09b1814 req-3e510513-441b-4df3-9845-7cb3b7ecc6ee service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:14.785086 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-4982cbde-fff8-46be-915d-2723a09b1814 req-3e510513-441b-4df3-9845-7cb3b7ecc6ee service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:14.794317 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-5c62fdd9-f7bc-4c2c-a1fa-74f45210b437 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:08:14.794855 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-4982cbde-fff8-46be-915d-2723a09b1814 req-3e510513-441b-4df3-9845-7cb3b7ecc6ee service nova] Creating event network-vif-deleted:8972ea33-9084-424f-ba1b-37260a6e9da8 for instance ff5a8410-e497-415f-be25-4a20e3345698 on hv-cinder-82002 Aug 11 11:08:14.794979 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-5c62fdd9-f7bc-4c2c-a1fa-74f45210b437 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] [instance: ff5a8410-e497-415f-be25-4a20e3345698] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:08:14.800256 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-4982cbde-fff8-46be-915d-2723a09b1814 req-3e510513-441b-4df3-9845-7cb3b7ecc6ee service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034557 Aug 11 11:08:14.801028 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 305/631] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:08:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:08:14.802312 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5c62fdd9-f7bc-4c2c-a1fa-74f45210b437 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:14.802939 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5c62fdd9-f7bc-4c2c-a1fa-74f45210b437 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:14.803477 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5c62fdd9-f7bc-4c2c-a1fa-74f45210b437 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:14.804815 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5c62fdd9-f7bc-4c2c-a1fa-74f45210b437 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:14.805276 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5c62fdd9-f7bc-4c2c-a1fa-74f45210b437 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:14.805728 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5c62fdd9-f7bc-4c2c-a1fa-74f45210b437 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:14.872919 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-5c62fdd9-f7bc-4c2c-a1fa-74f45210b437 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7493d38d24493b3298ac37592ecd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c8a1db00944c59950120c030ab47e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:14.880721 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-5c62fdd9-f7bc-4c2c-a1fa-74f45210b437 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] 10.222.0.48 "GET /compute/v2.1/servers/ff5a8410-e497-415f-be25-4a20e3345698" status: 200 len: 1473 microversion: 2.1 time: 0.090911 Aug 11 11:08:14.884177 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 327/632] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:08:14 2022] GET /compute/v2.1/servers/ff5a8410-e497-415f-be25-4a20e3345698 => generated 1473 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:08:15.859003 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-35880a5c-4072-45f8-bd85-7b9478f94aa3 req-5e8d4b55-9bab-4101-a60d-d201545e4ca4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "481c1d02-4070-4d58-8be2-438cd1a68eb5", "tag": "9c6e465a-0bd3-4725-9e9b-81120495670d"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:08:15.869090 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-35880a5c-4072-45f8-bd85-7b9478f94aa3 req-5e8d4b55-9bab-4101-a60d-d201545e4ca4 service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:15.870232 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-35880a5c-4072-45f8-bd85-7b9478f94aa3 req-5e8d4b55-9bab-4101-a60d-d201545e4ca4 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:15.870667 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-35880a5c-4072-45f8-bd85-7b9478f94aa3 req-5e8d4b55-9bab-4101-a60d-d201545e4ca4 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:15.883371 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-35880a5c-4072-45f8-bd85-7b9478f94aa3 req-5e8d4b55-9bab-4101-a60d-d201545e4ca4 service nova] Creating event network-changed:9c6e465a-0bd3-4725-9e9b-81120495670d for instance 481c1d02-4070-4d58-8be2-438cd1a68eb5 on hv-cinder-82002 Aug 11 11:08:15.888277 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-35880a5c-4072-45f8-bd85-7b9478f94aa3 req-5e8d4b55-9bab-4101-a60d-d201545e4ca4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033350 Aug 11 11:08:15.890759 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 306/633] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:08:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:08:15.901471 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-2ffcc8e9-911f-47b9-ae5e-dcd3cbee64d6 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:08:15.902099 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-2ffcc8e9-911f-47b9-ae5e-dcd3cbee64d6 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] [instance: ff5a8410-e497-415f-be25-4a20e3345698] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:08:15.908664 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2ffcc8e9-911f-47b9-ae5e-dcd3cbee64d6 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:15.909146 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2ffcc8e9-911f-47b9-ae5e-dcd3cbee64d6 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:15.909581 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2ffcc8e9-911f-47b9-ae5e-dcd3cbee64d6 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:15.910271 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2ffcc8e9-911f-47b9-ae5e-dcd3cbee64d6 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:15.910725 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2ffcc8e9-911f-47b9-ae5e-dcd3cbee64d6 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:15.911150 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2ffcc8e9-911f-47b9-ae5e-dcd3cbee64d6 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:15.943746 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2ffcc8e9-911f-47b9-ae5e-dcd3cbee64d6 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:15.944280 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2ffcc8e9-911f-47b9-ae5e-dcd3cbee64d6 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:15.944734 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2ffcc8e9-911f-47b9-ae5e-dcd3cbee64d6 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:15.945207 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.objects.instance [None req-2ffcc8e9-911f-47b9-ae5e-dcd3cbee64d6 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lazy-loading 'fault' on Instance uuid ff5a8410-e497-415f-be25-4a20e3345698 {{(pid=121232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 11:08:15.987523 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-2ffcc8e9-911f-47b9-ae5e-dcd3cbee64d6 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f2e7493d38d24493b3298ac37592ecd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c8a1db00944c59950120c030ab47e3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:15.994514 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-2ffcc8e9-911f-47b9-ae5e-dcd3cbee64d6 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] 10.222.0.48 "GET /compute/v2.1/servers/ff5a8410-e497-415f-be25-4a20e3345698" status: 200 len: 1309 microversion: 2.1 time: 0.096810 Aug 11 11:08:15.995717 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 328/634] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:08:15 2022] GET /compute/v2.1/servers/ff5a8410-e497-415f-be25-4a20e3345698 => generated 1309 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:08:17.019647 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-b7444e81-2fcf-495d-accd-5443fb63e326 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:08:17.020292 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-b7444e81-2fcf-495d-accd-5443fb63e326 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] [instance: ff5a8410-e497-415f-be25-4a20e3345698] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:08:17.026510 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b7444e81-2fcf-495d-accd-5443fb63e326 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:17.027004 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b7444e81-2fcf-495d-accd-5443fb63e326 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:17.027422 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b7444e81-2fcf-495d-accd-5443fb63e326 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:17.028137 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b7444e81-2fcf-495d-accd-5443fb63e326 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:17.028592 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b7444e81-2fcf-495d-accd-5443fb63e326 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:17.029018 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b7444e81-2fcf-495d-accd-5443fb63e326 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:17.041988 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.wsgi [None req-b7444e81-2fcf-495d-accd-5443fb63e326 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] HTTP exception thrown: Instance ff5a8410-e497-415f-be25-4a20e3345698 could not be found. Aug 11 11:08:17.043563 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-b7444e81-2fcf-495d-accd-5443fb63e326 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Request method failure captured: Aug 11 11:08:17.043563 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: request: GET /compute/v2.1/servers/ff5a8410-e497-415f-be25-4a20e3345698 HTTP/1.1 Aug 11 11:08:17.043563 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Accept: application/json Aug 11 11:08:17.043563 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Accept-Encoding: identity Aug 11 11:08:17.043563 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Connection: close Aug 11 11:08:17.043563 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Content-Length: 0 Aug 11 11:08:17.043563 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Content-Type: application/json Aug 11 11:08:17.043563 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Host: 10.222.0.48 Aug 11 11:08:17.043563 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Openstack-System-Scope: None Aug 11 11:08:17.043563 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: User-Agent: python-urllib3/1.26.11 Aug 11 11:08:17.043563 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Auth-Token: gAAAAABi9OJfVrmRjtaHjNf1dWcTTs4AKzzYN5gibYpu0R_Wnx2VGbP-hyndIXQKfPsmuI0H4uFwyqzzg5IHH1XBjPn2gI2sgSMvug7BXuu1CX7egvgm2iZR7CNdIrA1GO9DjPmD7aN2Tw20UwpJCSvrynBj5epYRAjtcDqaTpY2DHbVBE0TFbc Aug 11 11:08:17.043563 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Domain-Id: None Aug 11 11:08:17.043563 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Domain-Name: None Aug 11 11:08:17.043563 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Identity-Status: Confirmed Aug 11 11:08:17.043563 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Is-Admin-Project: True Aug 11 11:08:17.043563 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Domain-Id: default Aug 11 11:08:17.043563 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Domain-Name: Default Aug 11 11:08:17.043563 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Id: 23c8a1db00944c59950120c030ab47e3 Aug 11 11:08:17.043563 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1987776856 Aug 11 11:08:17.043563 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Role: reader,member Aug 11 11:08:17.043563 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Roles: reader,member Aug 11 11:08:17.045183 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c8a1db00944c59950120c030ab47e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/23c8a1db00944c59950120c030ab47e3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/23c8a1db00944c59950120c030ab47e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_23c8a1db00944c59950120c030ab47e3", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] Aug 11 11:08:17.045183 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant: tempest-VolumesSnapshotTestJSON-1987776856 Aug 11 11:08:17.045183 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant-Id: 23c8a1db00944c59950120c030ab47e3 Aug 11 11:08:17.045183 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1987776856 Aug 11 11:08:17.045183 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User: tempest-VolumesSnapshotTestJSON-1987776856-project Aug 11 11:08:17.045183 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Domain-Id: default Aug 11 11:08:17.045183 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Domain-Name: Default Aug 11 11:08:17.045183 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Id: f2e7493d38d24493b3298ac37592ecd4 Aug 11 11:08:17.045183 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Name: tempest-VolumesSnapshotTestJSON-1987776856-project Aug 11 11:08:17.045183 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: method: > Aug 11 11:08:17.045183 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: exception: Instance ff5a8410-e497-415f-be25-4a20e3345698 could not be found. Aug 11 11:08:17.045183 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: action_args: {'id': 'ff5a8410-e497-415f-be25-4a20e3345698'} Aug 11 11:08:17.046181 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 11:08:17.046181 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:08:17.046181 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 11:08:17.046181 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 11:08:17.046181 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 11:08:17.046181 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 11:08:17.046181 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 11:08:17.046181 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 11:08:17.046181 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 11:08:17.046181 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 11:08:17.046181 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff5a8410-e497-415f-be25-4a20e3345698 could not be found. Aug 11 11:08:17.046181 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:08:17.046181 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:08:17.046181 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:08:17.046181 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:08:17.046181 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:08:17.046181 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:08:17.046181 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 11:08:17.046181 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 11:08:17.046181 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 11:08:17.048008 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 11:08:17.048008 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 11:08:17.048008 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 11:08:17.048008 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 11:08:17.048008 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 11:08:17.048008 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 11:08:17.048008 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 11:08:17.048008 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff5a8410-e497-415f-be25-4a20e3345698 could not be found. Aug 11 11:08:17.048008 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:08:17.048008 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:08:17.048008 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:08:17.048008 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:08:17.048008 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:08:17.048008 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:08:17.048008 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 11:08:17.048008 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 11:08:17.048008 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff5a8410-e497-415f-be25-4a20e3345698 could not be found. Aug 11 11:08:17.048008 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:08:17.049246 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-b7444e81-2fcf-495d-accd-5443fb63e326 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] Returning 404 to user: Instance ff5a8410-e497-415f-be25-4a20e3345698 could not be found. {{(pid=121231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 11:08:17.049246 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-b7444e81-2fcf-495d-accd-5443fb63e326 tempest-VolumesSnapshotTestJSON-1987776856 tempest-VolumesSnapshotTestJSON-1987776856-project] 10.222.0.48 "GET /compute/v2.1/servers/ff5a8410-e497-415f-be25-4a20e3345698" status: 404 len: 111 microversion: 2.1 time: 0.030203 Aug 11 11:08:17.049246 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 307/635] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:08:17 2022] GET /compute/v2.1/servers/ff5a8410-e497-415f-be25-4a20e3345698 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 11:08:22.270178 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-4cd8f70e-943e-4db1-9dde-caedb2b4fcb3 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:08:22.270699 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-4cd8f70e-943e-4db1-9dde-caedb2b4fcb3 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:08:22.273347 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_api:SELECT=80 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:08:22.278024 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4cd8f70e-943e-4db1-9dde-caedb2b4fcb3 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:22.278490 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4cd8f70e-943e-4db1-9dde-caedb2b4fcb3 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:22.278915 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4cd8f70e-943e-4db1-9dde-caedb2b4fcb3 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:22.279637 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4cd8f70e-943e-4db1-9dde-caedb2b4fcb3 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:22.280123 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4cd8f70e-943e-4db1-9dde-caedb2b4fcb3 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:22.282548 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4cd8f70e-943e-4db1-9dde-caedb2b4fcb3 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:22.313308 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-4cd8f70e-943e-4db1-9dde-caedb2b4fcb3 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc/os-volume_attachments/86b39614-6b2a-4dfd-a40d-7afda8afcaa6" status: 200 len: 194 microversion: 2.20 time: 0.047031 Aug 11 11:08:22.313889 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 329/636] 10.222.0.48 () {60 vars in 1454 bytes} [Thu Aug 11 11:08:22 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc/os-volume_attachments/86b39614-6b2a-4dfd-a40d-7afda8afcaa6 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 11:08:22.381327 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-f3864a5f-0211-4b4e-985b-3a982bda1928 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:08:22.381893 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-f3864a5f-0211-4b4e-985b-3a982bda1928 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:08:22.384430 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:08:22.390878 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f3864a5f-0211-4b4e-985b-3a982bda1928 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:22.397399 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f3864a5f-0211-4b4e-985b-3a982bda1928 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:22.397399 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f3864a5f-0211-4b4e-985b-3a982bda1928 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:22.397399 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f3864a5f-0211-4b4e-985b-3a982bda1928 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:22.397399 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f3864a5f-0211-4b4e-985b-3a982bda1928 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:22.397777 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f3864a5f-0211-4b4e-985b-3a982bda1928 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:22.472791 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.objects.instance [None req-f3864a5f-0211-4b4e-985b-3a982bda1928 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lazy-loading 'services' on Instance uuid 82a61cf6-1f3f-4ced-9806-a06252b9b2cc {{(pid=121231) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 11:08:22.679674 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-f3864a5f-0211-4b4e-985b-3a982bda1928 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "DELETE /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc/os-volume_attachments/86b39614-6b2a-4dfd-a40d-7afda8afcaa6" status: 202 len: 0 microversion: 2.20 time: 0.302101 Aug 11 11:08:22.680210 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 308/637] 10.222.0.48 () {60 vars in 1457 bytes} [Thu Aug 11 11:08:22 2022] DELETE /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc/os-volume_attachments/86b39614-6b2a-4dfd-a40d-7afda8afcaa6 => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 11 11:08:22.689179 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-859caa15-fb60-4dd6-b48b-38282a22cdc4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:08:22.691478 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-859caa15-fb60-4dd6-b48b-38282a22cdc4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:08:22.697724 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-859caa15-fb60-4dd6-b48b-38282a22cdc4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:22.698227 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-859caa15-fb60-4dd6-b48b-38282a22cdc4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:22.698642 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-859caa15-fb60-4dd6-b48b-38282a22cdc4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:22.699330 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-859caa15-fb60-4dd6-b48b-38282a22cdc4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:22.699874 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-859caa15-fb60-4dd6-b48b-38282a22cdc4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:22.700305 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-859caa15-fb60-4dd6-b48b-38282a22cdc4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:22.729057 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-859caa15-fb60-4dd6-b48b-38282a22cdc4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044451 Aug 11 11:08:22.729613 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 330/638] 10.222.0.48 () {60 vars in 1343 bytes} [Thu Aug 11 11:08:22 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 11:08:23.747265 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-b8a6510b-1f97-4e88-83df-7c150a0c7c1b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:08:23.750430 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-b8a6510b-1f97-4e88-83df-7c150a0c7c1b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:08:23.756691 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b8a6510b-1f97-4e88-83df-7c150a0c7c1b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:23.757167 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b8a6510b-1f97-4e88-83df-7c150a0c7c1b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:23.757593 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b8a6510b-1f97-4e88-83df-7c150a0c7c1b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:23.758323 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b8a6510b-1f97-4e88-83df-7c150a0c7c1b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:23.758762 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b8a6510b-1f97-4e88-83df-7c150a0c7c1b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:23.759178 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b8a6510b-1f97-4e88-83df-7c150a0c7c1b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:23.789736 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-b8a6510b-1f97-4e88-83df-7c150a0c7c1b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051233 Aug 11 11:08:23.791189 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 309/639] 10.222.0.48 () {60 vars in 1343 bytes} [Thu Aug 11 11:08:23 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 11:08:24.803487 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-a2c141c2-2440-48ef-b6fd-b29ad92e75dc tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:08:24.805617 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-a2c141c2-2440-48ef-b6fd-b29ad92e75dc tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:08:24.812635 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a2c141c2-2440-48ef-b6fd-b29ad92e75dc tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:24.813108 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a2c141c2-2440-48ef-b6fd-b29ad92e75dc tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:24.813537 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a2c141c2-2440-48ef-b6fd-b29ad92e75dc tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:24.814242 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a2c141c2-2440-48ef-b6fd-b29ad92e75dc tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:24.814677 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a2c141c2-2440-48ef-b6fd-b29ad92e75dc tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:24.815098 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a2c141c2-2440-48ef-b6fd-b29ad92e75dc tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:24.818743 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:08:24.842790 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-a2c141c2-2440-48ef-b6fd-b29ad92e75dc tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043264 Aug 11 11:08:24.843355 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 331/640] 10.222.0.48 () {60 vars in 1343 bytes} [Thu Aug 11 11:08:24 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:08:24.904785 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-da28c928-fe5a-4c0b-ad7f-6ee04dda3818 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:08:24.905304 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-da28c928-fe5a-4c0b-ad7f-6ee04dda3818 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:08:24.913678 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-da28c928-fe5a-4c0b-ad7f-6ee04dda3818 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:24.914143 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-da28c928-fe5a-4c0b-ad7f-6ee04dda3818 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:24.914576 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-da28c928-fe5a-4c0b-ad7f-6ee04dda3818 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:24.915267 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-da28c928-fe5a-4c0b-ad7f-6ee04dda3818 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:24.915716 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-da28c928-fe5a-4c0b-ad7f-6ee04dda3818 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:24.916162 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-da28c928-fe5a-4c0b-ad7f-6ee04dda3818 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:24.942304 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-da28c928-fe5a-4c0b-ad7f-6ee04dda3818 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Going to try to terminate instance {{(pid=121231) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 11 11:08:25.257899 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-da28c928-fe5a-4c0b-ad7f-6ee04dda3818 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "DELETE /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 204 len: 0 microversion: 2.20 time: 0.356784 Aug 11 11:08:25.258505 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 310/641] 10.222.0.48 () {60 vars in 1280 bytes} [Thu Aug 11 11:08:24 2022] DELETE /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 11 11:08:25.266980 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-3fcca25b-2120-451d-8af6-bab5d6f49cee tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:08:25.267596 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-3fcca25b-2120-451d-8af6-bab5d6f49cee tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:08:25.274512 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3fcca25b-2120-451d-8af6-bab5d6f49cee tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:25.275039 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3fcca25b-2120-451d-8af6-bab5d6f49cee tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:25.275472 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3fcca25b-2120-451d-8af6-bab5d6f49cee tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:25.276194 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3fcca25b-2120-451d-8af6-bab5d6f49cee tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:25.276649 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3fcca25b-2120-451d-8af6-bab5d6f49cee tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:25.277074 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3fcca25b-2120-451d-8af6-bab5d6f49cee tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:25.419524 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-3fcca25b-2120-451d-8af6-bab5d6f49cee tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:25.427850 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-3fcca25b-2120-451d-8af6-bab5d6f49cee tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:25.429366 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-3fcca25b-2120-451d-8af6-bab5d6f49cee tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:25.430520 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-3fcca25b-2120-451d-8af6-bab5d6f49cee tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1721 microversion: 2.20 time: 0.167603 Aug 11 11:08:25.431087 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 332/642] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:08:25 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:08:26.454243 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-96af8225-ba09-4e9f-9851-d649839ca4a6 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:08:26.454940 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-96af8225-ba09-4e9f-9851-d649839ca4a6 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:08:26.461898 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-96af8225-ba09-4e9f-9851-d649839ca4a6 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:26.462382 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-96af8225-ba09-4e9f-9851-d649839ca4a6 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:26.462815 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-96af8225-ba09-4e9f-9851-d649839ca4a6 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:26.463503 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-96af8225-ba09-4e9f-9851-d649839ca4a6 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:26.464015 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-96af8225-ba09-4e9f-9851-d649839ca4a6 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:26.469121 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-96af8225-ba09-4e9f-9851-d649839ca4a6 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:26.598841 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-96af8225-ba09-4e9f-9851-d649839ca4a6 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:26.607313 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-96af8225-ba09-4e9f-9851-d649839ca4a6 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:26.609477 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-96af8225-ba09-4e9f-9851-d649839ca4a6 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:26.610624 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-96af8225-ba09-4e9f-9851-d649839ca4a6 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1721 microversion: 2.20 time: 0.160822 Aug 11 11:08:26.611177 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 311/643] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:08:26 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:08:27.632877 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-bd6de492-5f39-4f1b-ae10-a9357952c089 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:08:27.633492 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-bd6de492-5f39-4f1b-ae10-a9357952c089 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:08:27.640882 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bd6de492-5f39-4f1b-ae10-a9357952c089 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:27.641408 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bd6de492-5f39-4f1b-ae10-a9357952c089 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:27.641845 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bd6de492-5f39-4f1b-ae10-a9357952c089 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:27.642568 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bd6de492-5f39-4f1b-ae10-a9357952c089 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:27.643021 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bd6de492-5f39-4f1b-ae10-a9357952c089 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:27.643445 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bd6de492-5f39-4f1b-ae10-a9357952c089 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:27.777492 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-bd6de492-5f39-4f1b-ae10-a9357952c089 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:27.785505 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-bd6de492-5f39-4f1b-ae10-a9357952c089 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:27.786995 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-bd6de492-5f39-4f1b-ae10-a9357952c089 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:27.793003 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-bd6de492-5f39-4f1b-ae10-a9357952c089 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1721 microversion: 2.20 time: 0.159249 Aug 11 11:08:27.793003 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 333/644] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:08:27 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:08:28.225760 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-7f298205-e2f3-4db3-bddc-e3c6e3dca9e5 req-cf813ddc-a7a6-4450-9e58-dbd36589c175 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82a61cf6-1f3f-4ced-9806-a06252b9b2cc", "name": "network-vif-deleted", "tag": "71bca2c4-19df-4dc2-ad61-c7058687c043"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:08:28.236554 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-7f298205-e2f3-4db3-bddc-e3c6e3dca9e5 req-cf813ddc-a7a6-4450-9e58-dbd36589c175 service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:28.237030 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-7f298205-e2f3-4db3-bddc-e3c6e3dca9e5 req-cf813ddc-a7a6-4450-9e58-dbd36589c175 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:28.237452 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-7f298205-e2f3-4db3-bddc-e3c6e3dca9e5 req-cf813ddc-a7a6-4450-9e58-dbd36589c175 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:28.248732 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-7f298205-e2f3-4db3-bddc-e3c6e3dca9e5 req-cf813ddc-a7a6-4450-9e58-dbd36589c175 service nova] Creating event network-vif-deleted:71bca2c4-19df-4dc2-ad61-c7058687c043 for instance 82a61cf6-1f3f-4ced-9806-a06252b9b2cc on hv-cinder-82002 Aug 11 11:08:28.254383 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-7f298205-e2f3-4db3-bddc-e3c6e3dca9e5 req-cf813ddc-a7a6-4450-9e58-dbd36589c175 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032449 Aug 11 11:08:28.254981 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 312/645] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:08:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:08:28.812226 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-5e453bf2-bc9e-4d24-a9fa-0b10da40a438 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:08:28.813001 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-5e453bf2-bc9e-4d24-a9fa-0b10da40a438 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:08:28.819450 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5e453bf2-bc9e-4d24-a9fa-0b10da40a438 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:28.820039 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5e453bf2-bc9e-4d24-a9fa-0b10da40a438 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:28.820574 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5e453bf2-bc9e-4d24-a9fa-0b10da40a438 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:28.821369 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5e453bf2-bc9e-4d24-a9fa-0b10da40a438 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:28.821927 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5e453bf2-bc9e-4d24-a9fa-0b10da40a438 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:28.822454 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5e453bf2-bc9e-4d24-a9fa-0b10da40a438 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:28.855745 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5e453bf2-bc9e-4d24-a9fa-0b10da40a438 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:28.856369 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5e453bf2-bc9e-4d24-a9fa-0b10da40a438 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:28.856866 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5e453bf2-bc9e-4d24-a9fa-0b10da40a438 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:28.857383 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.objects.instance [None req-5e453bf2-bc9e-4d24-a9fa-0b10da40a438 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lazy-loading 'fault' on Instance uuid 82a61cf6-1f3f-4ced-9806-a06252b9b2cc {{(pid=121232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 11:08:28.899671 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-5e453bf2-bc9e-4d24-a9fa-0b10da40a438 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:28.908671 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-5e453bf2-bc9e-4d24-a9fa-0b10da40a438 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:28.910170 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-5e453bf2-bc9e-4d24-a9fa-0b10da40a438 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:28.911360 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-5e453bf2-bc9e-4d24-a9fa-0b10da40a438 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1370 microversion: 2.20 time: 0.103266 Aug 11 11:08:28.911947 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 334/646] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:08:28 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1370 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:08:29.939744 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-eff300f5-3e86-41c3-bf81-0403c61358e0 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:08:29.939744 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-eff300f5-3e86-41c3-bf81-0403c61358e0 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:08:29.943586 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-eff300f5-3e86-41c3-bf81-0403c61358e0 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:29.944087 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-eff300f5-3e86-41c3-bf81-0403c61358e0 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:29.944518 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-eff300f5-3e86-41c3-bf81-0403c61358e0 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:29.945196 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-eff300f5-3e86-41c3-bf81-0403c61358e0 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:29.945636 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-eff300f5-3e86-41c3-bf81-0403c61358e0 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:29.946055 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-eff300f5-3e86-41c3-bf81-0403c61358e0 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:29.978138 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-eff300f5-3e86-41c3-bf81-0403c61358e0 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:29.978610 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-eff300f5-3e86-41c3-bf81-0403c61358e0 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:29.979034 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-eff300f5-3e86-41c3-bf81-0403c61358e0 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:29.979467 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.objects.instance [None req-eff300f5-3e86-41c3-bf81-0403c61358e0 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lazy-loading 'fault' on Instance uuid 82a61cf6-1f3f-4ced-9806-a06252b9b2cc {{(pid=121231) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 11:08:30.024446 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-eff300f5-3e86-41c3-bf81-0403c61358e0 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:30.032918 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-eff300f5-3e86-41c3-bf81-0403c61358e0 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:30.034423 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-eff300f5-3e86-41c3-bf81-0403c61358e0 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:30.035600 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-eff300f5-3e86-41c3-bf81-0403c61358e0 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1370 microversion: 2.20 time: 0.104849 Aug 11 11:08:30.036203 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 313/647] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:08:29 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1370 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:08:31.058810 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-a6f8b154-1814-4579-af34-e51c36921b86 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:08:31.059366 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-a6f8b154-1814-4579-af34-e51c36921b86 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:08:31.065711 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a6f8b154-1814-4579-af34-e51c36921b86 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:31.066188 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a6f8b154-1814-4579-af34-e51c36921b86 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:31.066619 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a6f8b154-1814-4579-af34-e51c36921b86 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:31.067297 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a6f8b154-1814-4579-af34-e51c36921b86 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:31.067788 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a6f8b154-1814-4579-af34-e51c36921b86 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:31.068215 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a6f8b154-1814-4579-af34-e51c36921b86 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:31.098137 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a6f8b154-1814-4579-af34-e51c36921b86 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:31.098629 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a6f8b154-1814-4579-af34-e51c36921b86 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:31.099062 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a6f8b154-1814-4579-af34-e51c36921b86 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:31.099500 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.objects.instance [None req-a6f8b154-1814-4579-af34-e51c36921b86 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lazy-loading 'fault' on Instance uuid 82a61cf6-1f3f-4ced-9806-a06252b9b2cc {{(pid=121232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 11:08:31.139297 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-a6f8b154-1814-4579-af34-e51c36921b86 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:31.147222 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-a6f8b154-1814-4579-af34-e51c36921b86 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:31.148762 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-a6f8b154-1814-4579-af34-e51c36921b86 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:31.149912 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-a6f8b154-1814-4579-af34-e51c36921b86 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 200 len: 1370 microversion: 2.20 time: 0.095113 Aug 11 11:08:31.150474 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 335/648] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:08:31 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 1370 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:08:32.173116 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-1a92281a-1ffc-4f07-b7fc-100042d8a9e7 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:08:32.173641 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-1a92281a-1ffc-4f07-b7fc-100042d8a9e7 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:08:32.179995 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1a92281a-1ffc-4f07-b7fc-100042d8a9e7 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:32.180474 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1a92281a-1ffc-4f07-b7fc-100042d8a9e7 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:32.187061 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1a92281a-1ffc-4f07-b7fc-100042d8a9e7 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:32.187061 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1a92281a-1ffc-4f07-b7fc-100042d8a9e7 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:32.187061 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1a92281a-1ffc-4f07-b7fc-100042d8a9e7 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:32.187061 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1a92281a-1ffc-4f07-b7fc-100042d8a9e7 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:32.195865 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.wsgi [None req-1a92281a-1ffc-4f07-b7fc-100042d8a9e7 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] HTTP exception thrown: Instance 82a61cf6-1f3f-4ced-9806-a06252b9b2cc could not be found. Aug 11 11:08:32.197465 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-1a92281a-1ffc-4f07-b7fc-100042d8a9e7 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Request method failure captured: Aug 11 11:08:32.197465 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: request: GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc HTTP/1.1 Aug 11 11:08:32.197465 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Accept: application/json Aug 11 11:08:32.197465 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Accept-Encoding: identity Aug 11 11:08:32.197465 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Connection: close Aug 11 11:08:32.197465 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Content-Length: 0 Aug 11 11:08:32.197465 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Content-Type: application/json Aug 11 11:08:32.197465 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Host: 10.222.0.48 Aug 11 11:08:32.197465 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Openstack-System-Scope: None Aug 11 11:08:32.197465 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: User-Agent: python-urllib3/1.26.11 Aug 11 11:08:32.197465 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Auth-Token: gAAAAABi9OIaind48uIVvmwwSl55jcJkxEpAVZyB6nQdk1mWfLgWh8LC4f_b2UqUcZdlSYLC9ri7Dtckz_FnJBPC66nr6BI9o-qDaDKgS3cmtdrMuyXBFqQXPcd6n5yHEgCDE9tBh59Z5qHXanyrEHj4QnsP2iU8hR2FG73mdLPDYggCf2HEuKQ Aug 11 11:08:32.197465 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Domain-Id: None Aug 11 11:08:32.197465 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Domain-Name: None Aug 11 11:08:32.197465 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Identity-Status: Confirmed Aug 11 11:08:32.197465 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Is-Admin-Project: True Aug 11 11:08:32.197465 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Openstack-Nova-Api-Version: 2.20 Aug 11 11:08:32.197465 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Domain-Id: default Aug 11 11:08:32.197465 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Domain-Name: Default Aug 11 11:08:32.197465 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Id: c42a3b4ef2d644b58856779226688f88 Aug 11 11:08:32.197465 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1667074018 Aug 11 11:08:32.197465 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Role: reader,member Aug 11 11:08:32.197465 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Roles: reader,member Aug 11 11:08:32.199002 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c42a3b4ef2d644b58856779226688f88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c42a3b4ef2d644b58856779226688f88"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c42a3b4ef2d644b58856779226688f88"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c42a3b4ef2d644b58856779226688f88", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] Aug 11 11:08:32.199002 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1667074018 Aug 11 11:08:32.199002 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant-Id: c42a3b4ef2d644b58856779226688f88 Aug 11 11:08:32.199002 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1667074018 Aug 11 11:08:32.199002 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User: tempest-AttachVolumeShelveTestJSON-1667074018-project Aug 11 11:08:32.199002 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Domain-Id: default Aug 11 11:08:32.199002 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Domain-Name: Default Aug 11 11:08:32.199002 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Id: 1b7724f3ef4543ed9c3df0455ae4fb76 Aug 11 11:08:32.199002 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1667074018-project Aug 11 11:08:32.199002 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: method: > Aug 11 11:08:32.199002 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: exception: Instance 82a61cf6-1f3f-4ced-9806-a06252b9b2cc could not be found. Aug 11 11:08:32.199002 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: action_args: {'id': '82a61cf6-1f3f-4ced-9806-a06252b9b2cc'} Aug 11 11:08:32.199830 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 11:08:32.199830 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:08:32.199830 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 11:08:32.199830 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 11:08:32.199830 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 11:08:32.199830 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 11:08:32.199830 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 11:08:32.199830 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 11:08:32.199830 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 11:08:32.199830 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 11:08:32.199830 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82a61cf6-1f3f-4ced-9806-a06252b9b2cc could not be found. Aug 11 11:08:32.199830 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:08:32.199830 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:08:32.199830 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:08:32.199830 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:08:32.199830 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:08:32.199830 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:08:32.199830 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 11:08:32.199830 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 11:08:32.199830 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 11:08:32.201230 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 11:08:32.201230 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 11:08:32.201230 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 11:08:32.201230 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 11:08:32.201230 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 11:08:32.201230 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 11:08:32.201230 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 11:08:32.201230 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82a61cf6-1f3f-4ced-9806-a06252b9b2cc could not be found. Aug 11 11:08:32.201230 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:08:32.201230 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:08:32.201230 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:08:32.201230 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:08:32.201230 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:08:32.201230 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:08:32.201230 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 11:08:32.201230 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 11:08:32.201230 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82a61cf6-1f3f-4ced-9806-a06252b9b2cc could not be found. Aug 11 11:08:32.201230 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:08:32.202700 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-1a92281a-1ffc-4f07-b7fc-100042d8a9e7 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Returning 404 to user: Instance 82a61cf6-1f3f-4ced-9806-a06252b9b2cc could not be found. {{(pid=121231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 11:08:32.202700 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-1a92281a-1ffc-4f07-b7fc-100042d8a9e7 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 404 len: 111 microversion: 2.20 time: 0.030046 Aug 11 11:08:32.202700 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 314/649] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:08:32 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 11 11:08:32.208496 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-ad5990bb-1d81-4c80-82c0-583a6f2492d1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '.version_select at 0x7faab0b8baf0>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:08:32.292314 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-ad5990bb-1d81-4c80-82c0-583a6f2492d1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-427342936" status: 204 len: 0 microversion: 2.20 time: 0.087670 Aug 11 11:08:32.292904 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 336/650] 10.222.0.48 () {60 vars in 1259 bytes} [Thu Aug 11 11:08:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-427342936 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 11 11:08:33.107290 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-08fadb96-5d38-4a27-8010-57c34f9f6775 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Action: 'create', calling method: .version_select at 0x7faab0a71550>, body: {"keypair": {"name": "tempest-keypair-1138604088", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBByMRpF+z3EWxVdXGWWo3USWAgOL8dK+lQG7N3brNt6fYS5/f/92QhrrpatfQGtLE0rEKguBK6my0vAjRU9dXQIjgC0cdRgpWjcnQBZv24IulA7TKpif2e7eWFoHDDSv8g=="}} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:08:33.123151 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.quota [None req-08fadb96-5d38-4a27-8010-57c34f9f6775 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Getting quotas for project c42a3b4ef2d644b58856779226688f88. Resources: {'key_pairs'} {{(pid=121231) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 11:08:33.127234 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.quota [None req-08fadb96-5d38-4a27-8010-57c34f9f6775 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Getting quotas for user 1b7724f3ef4543ed9c3df0455ae4fb76 and project c42a3b4ef2d644b58856779226688f88. Resources: {'key_pairs'} {{(pid=121231) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 11:08:33.202282 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-08fadb96-5d38-4a27-8010-57c34f9f6775 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.098749 Aug 11 11:08:33.204792 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 315/651] 10.222.0.48 () {62 vars in 1200 bytes} [Thu Aug 11 11:08:33 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 101 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 11 11:08:35.762684 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-462c1f04-b4fb-40e8-bffd-3631208ae48e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1573949527", "imageRef": "05993162-aafd-4f1d-b781-ec09593713e5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "52ea2947-a913-4941-bc7f-78d92d3d4a71"}], "security_groups": [{"name": "tempest-securitygroup--648326495"}], "key_name": "tempest-keypair-1138604088", "user_data": "}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:08:35.864964 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.network.neutron [None req-462c1f04-b4fb-40e8-bffd-3631208ae48e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] validate_networks() for [('52ea2947-a913-4941-bc7f-78d92d3d4a71', None, None, None, None, None)] {{(pid=121232) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 11 11:08:36.226859 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-462c1f04-b4fb-40e8-bffd-3631208ae48e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Flavor limits 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 11 11:08:36.227282 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-462c1f04-b4fb-40e8-bffd-3631208ae48e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Image limits 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 11 11:08:36.227750 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-462c1f04-b4fb-40e8-bffd-3631208ae48e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Flavor pref 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 11 11:08:36.228255 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-462c1f04-b4fb-40e8-bffd-3631208ae48e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Image pref 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 11 11:08:36.228711 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-462c1f04-b4fb-40e8-bffd-3631208ae48e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 11 11:08:36.238254 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-462c1f04-b4fb-40e8-bffd-3631208ae48e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:36.238734 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-462c1f04-b4fb-40e8-bffd-3631208ae48e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:36.239159 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-462c1f04-b4fb-40e8-bffd-3631208ae48e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:36.239939 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-462c1f04-b4fb-40e8-bffd-3631208ae48e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:36.240381 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-462c1f04-b4fb-40e8-bffd-3631208ae48e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:36.240795 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-462c1f04-b4fb-40e8-bffd-3631208ae48e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:36.257917 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-462c1f04-b4fb-40e8-bffd-3631208ae48e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Getting quotas for project c42a3b4ef2d644b58856779226688f88. Resources: {'ram', 'cores', 'instances'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 11:08:36.261896 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-462c1f04-b4fb-40e8-bffd-3631208ae48e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Getting quotas for user 1b7724f3ef4543ed9c3df0455ae4fb76 and project c42a3b4ef2d644b58856779226688f88. Resources: {'ram', 'cores', 'instances'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 11:08:36.272433 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-462c1f04-b4fb-40e8-bffd-3631208ae48e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Going to run 1 instances... {{(pid=121232) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 11 11:08:36.274657 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-462c1f04-b4fb-40e8-bffd-3631208ae48e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: ab871db0-6362-4dd3-b29c-b513351e027b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='05993162-aafd-4f1d-b781-ec09593713e5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121232) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 11 11:08:36.402033 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-462c1f04-b4fb-40e8-bffd-3631208ae48e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.644096 Aug 11 11:08:36.402604 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 337/652] 10.222.0.48 () {62 vars in 1188 bytes} [Thu Aug 11 11:08:35 2022] POST /compute/v2.1/servers => generated 401 bytes in 645 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 11 11:08:36.413617 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-e54750bc-24f5-4c14-b407-3b327648ef5c tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:08:36.414868 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-e54750bc-24f5-4c14-b407-3b327648ef5c tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: ab871db0-6362-4dd3-b29c-b513351e027b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:08:36.473808 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-e54750bc-24f5-4c14-b407-3b327648ef5c tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:36.481199 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-e54750bc-24f5-4c14-b407-3b327648ef5c tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:36.482742 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-e54750bc-24f5-4c14-b407-3b327648ef5c tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:36.483920 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-e54750bc-24f5-4c14-b407-3b327648ef5c tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b" status: 200 len: 1282 microversion: 2.20 time: 0.074215 Aug 11 11:08:36.484489 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 316/653] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:08:36 2022] GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b => generated 1282 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:08:37.507095 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-5fca384a-b943-44af-841a-5ad2a373bcc1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:08:37.507725 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-5fca384a-b943-44af-841a-5ad2a373bcc1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: ab871db0-6362-4dd3-b29c-b513351e027b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:08:37.513755 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5fca384a-b943-44af-841a-5ad2a373bcc1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:37.514211 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5fca384a-b943-44af-841a-5ad2a373bcc1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:37.514638 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5fca384a-b943-44af-841a-5ad2a373bcc1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:37.515345 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5fca384a-b943-44af-841a-5ad2a373bcc1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:37.515901 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5fca384a-b943-44af-841a-5ad2a373bcc1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:37.516356 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5fca384a-b943-44af-841a-5ad2a373bcc1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:37.745073 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-5fca384a-b943-44af-841a-5ad2a373bcc1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:37.753793 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-5fca384a-b943-44af-841a-5ad2a373bcc1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:37.755310 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-5fca384a-b943-44af-841a-5ad2a373bcc1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:37.756466 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-5fca384a-b943-44af-841a-5ad2a373bcc1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b" status: 200 len: 1286 microversion: 2.20 time: 0.253896 Aug 11 11:08:37.757007 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 338/654] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:08:37 2022] GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b => generated 1286 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:08:38.779190 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-0586b2c5-2911-4f4c-aecb-85d073c084cc tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:08:38.780934 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-0586b2c5-2911-4f4c-aecb-85d073c084cc tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: ab871db0-6362-4dd3-b29c-b513351e027b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:08:38.787653 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0586b2c5-2911-4f4c-aecb-85d073c084cc tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:38.788167 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0586b2c5-2911-4f4c-aecb-85d073c084cc tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:38.788600 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0586b2c5-2911-4f4c-aecb-85d073c084cc tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:38.789513 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0586b2c5-2911-4f4c-aecb-85d073c084cc tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:38.790144 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0586b2c5-2911-4f4c-aecb-85d073c084cc tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:38.790567 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0586b2c5-2911-4f4c-aecb-85d073c084cc tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:38.908401 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-0586b2c5-2911-4f4c-aecb-85d073c084cc tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:38.917305 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-0586b2c5-2911-4f4c-aecb-85d073c084cc tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:38.918822 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-0586b2c5-2911-4f4c-aecb-85d073c084cc tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:38.919966 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-0586b2c5-2911-4f4c-aecb-85d073c084cc tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b" status: 200 len: 1342 microversion: 2.20 time: 0.144725 Aug 11 11:08:38.920574 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 317/655] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:08:38 2022] GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b => generated 1342 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:08:39.947082 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-b5a06d64-ebc2-407a-af79-75c85c38d0ab tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:08:39.947688 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-b5a06d64-ebc2-407a-af79-75c85c38d0ab tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: ab871db0-6362-4dd3-b29c-b513351e027b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:08:39.953894 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b5a06d64-ebc2-407a-af79-75c85c38d0ab tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:39.954370 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b5a06d64-ebc2-407a-af79-75c85c38d0ab tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:39.954801 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b5a06d64-ebc2-407a-af79-75c85c38d0ab tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:39.955502 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b5a06d64-ebc2-407a-af79-75c85c38d0ab tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:39.955990 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b5a06d64-ebc2-407a-af79-75c85c38d0ab tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:39.956431 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b5a06d64-ebc2-407a-af79-75c85c38d0ab tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:40.092405 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-b5a06d64-ebc2-407a-af79-75c85c38d0ab tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:40.100657 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-b5a06d64-ebc2-407a-af79-75c85c38d0ab tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:40.102193 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-b5a06d64-ebc2-407a-af79-75c85c38d0ab tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:40.103299 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-b5a06d64-ebc2-407a-af79-75c85c38d0ab tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b" status: 200 len: 1407 microversion: 2.20 time: 0.160187 Aug 11 11:08:40.103889 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 339/656] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:08:39 2022] GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:08:40.277931 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-e106a028-067e-4b7d-b5a9-e12f95b5af7e req-bbb6e48c-ccae-4576-973f-f8f69ce24d5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab871db0-6362-4dd3-b29c-b513351e027b", "tag": "1f4049ad-be47-41fe-a43f-26460abf19d8"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:08:40.288425 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-e106a028-067e-4b7d-b5a9-e12f95b5af7e req-bbb6e48c-ccae-4576-973f-f8f69ce24d5c service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:40.288955 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-e106a028-067e-4b7d-b5a9-e12f95b5af7e req-bbb6e48c-ccae-4576-973f-f8f69ce24d5c service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:40.289376 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-e106a028-067e-4b7d-b5a9-e12f95b5af7e req-bbb6e48c-ccae-4576-973f-f8f69ce24d5c service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:40.301024 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-e106a028-067e-4b7d-b5a9-e12f95b5af7e req-bbb6e48c-ccae-4576-973f-f8f69ce24d5c service nova] Creating event network-changed:1f4049ad-be47-41fe-a43f-26460abf19d8 for instance ab871db0-6362-4dd3-b29c-b513351e027b on hv-cinder-82002 Aug 11 11:08:40.305763 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-e106a028-067e-4b7d-b5a9-e12f95b5af7e req-bbb6e48c-ccae-4576-973f-f8f69ce24d5c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031480 Aug 11 11:08:40.306347 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 318/657] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:08:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:08:41.126181 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-00888bc1-5a22-4dbf-bdee-c3688818c9d6 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:08:41.126778 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-00888bc1-5a22-4dbf-bdee-c3688818c9d6 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: ab871db0-6362-4dd3-b29c-b513351e027b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:08:41.133755 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-00888bc1-5a22-4dbf-bdee-c3688818c9d6 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:41.134232 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-00888bc1-5a22-4dbf-bdee-c3688818c9d6 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:41.134661 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-00888bc1-5a22-4dbf-bdee-c3688818c9d6 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:41.135352 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-00888bc1-5a22-4dbf-bdee-c3688818c9d6 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:41.135826 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-00888bc1-5a22-4dbf-bdee-c3688818c9d6 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:41.136251 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-00888bc1-5a22-4dbf-bdee-c3688818c9d6 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:41.264150 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-00888bc1-5a22-4dbf-bdee-c3688818c9d6 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:41.272630 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-00888bc1-5a22-4dbf-bdee-c3688818c9d6 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:41.274127 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-00888bc1-5a22-4dbf-bdee-c3688818c9d6 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:41.275217 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-00888bc1-5a22-4dbf-bdee-c3688818c9d6 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b" status: 200 len: 1407 microversion: 2.20 time: 0.152955 Aug 11 11:08:41.275793 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 340/658] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:08:41 2022] GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:08:42.299073 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-a3d3517c-009f-47bf-bc6f-3b00b7653a11 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:08:42.299860 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-a3d3517c-009f-47bf-bc6f-3b00b7653a11 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: ab871db0-6362-4dd3-b29c-b513351e027b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:08:42.306098 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a3d3517c-009f-47bf-bc6f-3b00b7653a11 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:42.306667 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a3d3517c-009f-47bf-bc6f-3b00b7653a11 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:42.307236 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a3d3517c-009f-47bf-bc6f-3b00b7653a11 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:42.308081 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a3d3517c-009f-47bf-bc6f-3b00b7653a11 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:42.308567 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a3d3517c-009f-47bf-bc6f-3b00b7653a11 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:42.308982 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a3d3517c-009f-47bf-bc6f-3b00b7653a11 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:42.449528 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-a3d3517c-009f-47bf-bc6f-3b00b7653a11 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:42.458156 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-a3d3517c-009f-47bf-bc6f-3b00b7653a11 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:42.459600 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-a3d3517c-009f-47bf-bc6f-3b00b7653a11 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:42.460731 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-a3d3517c-009f-47bf-bc6f-3b00b7653a11 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b" status: 200 len: 1407 microversion: 2.20 time: 0.166945 Aug 11 11:08:42.461298 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 319/659] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:08:42 2022] GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:08:43.484245 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-32b46d1a-7b16-4aa3-9672-77416d8bae80 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:08:43.484854 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-32b46d1a-7b16-4aa3-9672-77416d8bae80 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: ab871db0-6362-4dd3-b29c-b513351e027b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:08:43.491273 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-32b46d1a-7b16-4aa3-9672-77416d8bae80 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:43.491747 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-32b46d1a-7b16-4aa3-9672-77416d8bae80 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:43.492214 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-32b46d1a-7b16-4aa3-9672-77416d8bae80 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:43.492946 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-32b46d1a-7b16-4aa3-9672-77416d8bae80 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:43.493355 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-32b46d1a-7b16-4aa3-9672-77416d8bae80 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:43.493779 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-32b46d1a-7b16-4aa3-9672-77416d8bae80 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:43.628660 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-32b46d1a-7b16-4aa3-9672-77416d8bae80 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:43.636746 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-32b46d1a-7b16-4aa3-9672-77416d8bae80 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:43.638265 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-32b46d1a-7b16-4aa3-9672-77416d8bae80 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:43.639372 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-32b46d1a-7b16-4aa3-9672-77416d8bae80 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b" status: 200 len: 1407 microversion: 2.20 time: 0.159137 Aug 11 11:08:43.639962 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 341/660] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:08:43 2022] GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:08:44.661567 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-02f08e71-e94d-4f25-a197-55063a9fcb74 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:08:44.662192 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-02f08e71-e94d-4f25-a197-55063a9fcb74 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: ab871db0-6362-4dd3-b29c-b513351e027b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:08:44.668551 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-02f08e71-e94d-4f25-a197-55063a9fcb74 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:44.669019 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-02f08e71-e94d-4f25-a197-55063a9fcb74 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:44.669447 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-02f08e71-e94d-4f25-a197-55063a9fcb74 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:44.670136 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-02f08e71-e94d-4f25-a197-55063a9fcb74 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:44.670577 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-02f08e71-e94d-4f25-a197-55063a9fcb74 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:44.671249 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-02f08e71-e94d-4f25-a197-55063a9fcb74 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:44.675729 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell1:SELECT=76,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:08:44.805985 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-02f08e71-e94d-4f25-a197-55063a9fcb74 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:44.814059 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-02f08e71-e94d-4f25-a197-55063a9fcb74 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:44.815650 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-02f08e71-e94d-4f25-a197-55063a9fcb74 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:44.819897 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-02f08e71-e94d-4f25-a197-55063a9fcb74 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b" status: 200 len: 1407 microversion: 2.20 time: 0.159060 Aug 11 11:08:44.819897 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 320/661] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:08:44 2022] GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:08:45.838578 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-27065f85-36e7-49e6-84da-d8f512822f2b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:08:45.839185 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-27065f85-36e7-49e6-84da-d8f512822f2b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: ab871db0-6362-4dd3-b29c-b513351e027b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:08:45.845804 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-27065f85-36e7-49e6-84da-d8f512822f2b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:45.846357 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-27065f85-36e7-49e6-84da-d8f512822f2b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:45.846791 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-27065f85-36e7-49e6-84da-d8f512822f2b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:45.847481 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-27065f85-36e7-49e6-84da-d8f512822f2b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:45.847971 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-27065f85-36e7-49e6-84da-d8f512822f2b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:45.848397 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-27065f85-36e7-49e6-84da-d8f512822f2b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:45.981791 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-27065f85-36e7-49e6-84da-d8f512822f2b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:45.990466 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-27065f85-36e7-49e6-84da-d8f512822f2b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:45.992250 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-27065f85-36e7-49e6-84da-d8f512822f2b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:45.993359 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-27065f85-36e7-49e6-84da-d8f512822f2b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b" status: 200 len: 1407 microversion: 2.20 time: 0.158828 Aug 11 11:08:45.994091 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 342/662] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:08:45 2022] GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:08:47.017006 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-dc6c8611-72c0-47ec-b0a4-d0b691061669 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:08:47.018213 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-dc6c8611-72c0-47ec-b0a4-d0b691061669 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: ab871db0-6362-4dd3-b29c-b513351e027b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:08:47.021246 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell0:SELECT=6 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:08:47.027227 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-dc6c8611-72c0-47ec-b0a4-d0b691061669 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:47.028012 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-dc6c8611-72c0-47ec-b0a4-d0b691061669 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:47.028814 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-dc6c8611-72c0-47ec-b0a4-d0b691061669 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:47.029605 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-dc6c8611-72c0-47ec-b0a4-d0b691061669 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:47.030118 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-dc6c8611-72c0-47ec-b0a4-d0b691061669 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:47.030590 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-dc6c8611-72c0-47ec-b0a4-d0b691061669 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:47.168700 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-dc6c8611-72c0-47ec-b0a4-d0b691061669 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:47.178447 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-dc6c8611-72c0-47ec-b0a4-d0b691061669 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:47.180264 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-dc6c8611-72c0-47ec-b0a4-d0b691061669 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:47.181569 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-dc6c8611-72c0-47ec-b0a4-d0b691061669 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b" status: 200 len: 1407 microversion: 2.20 time: 0.168705 Aug 11 11:08:47.182390 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 321/663] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:08:47 2022] GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:08:47.325865 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-90db0980-117a-4c9e-b55f-ff56b928de69 req-e6cb3551-9966-48f8-a41b-925dc71ae94a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab871db0-6362-4dd3-b29c-b513351e027b", "name": "network-vif-plugged", "status": "completed", "tag": "1f4049ad-be47-41fe-a43f-26460abf19d8"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:08:47.331587 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell0:SELECT=2 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:08:47.332306 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell0:SELECT=6 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:08:47.338054 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-90db0980-117a-4c9e-b55f-ff56b928de69 req-e6cb3551-9966-48f8-a41b-925dc71ae94a service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:47.338672 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-90db0980-117a-4c9e-b55f-ff56b928de69 req-e6cb3551-9966-48f8-a41b-925dc71ae94a service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:47.338983 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-90db0980-117a-4c9e-b55f-ff56b928de69 req-e6cb3551-9966-48f8-a41b-925dc71ae94a service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:47.351066 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-90db0980-117a-4c9e-b55f-ff56b928de69 req-e6cb3551-9966-48f8-a41b-925dc71ae94a service nova] Creating event network-vif-plugged:1f4049ad-be47-41fe-a43f-26460abf19d8 for instance ab871db0-6362-4dd3-b29c-b513351e027b on hv-cinder-82002 Aug 11 11:08:47.356583 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-90db0980-117a-4c9e-b55f-ff56b928de69 req-e6cb3551-9966-48f8-a41b-925dc71ae94a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034403 Aug 11 11:08:47.357576 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 343/664] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:08:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:08:48.205515 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-da48e410-30bf-40d0-8dea-08e2d26203f8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:08:48.206234 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-da48e410-30bf-40d0-8dea-08e2d26203f8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: ab871db0-6362-4dd3-b29c-b513351e027b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:08:48.215462 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-da48e410-30bf-40d0-8dea-08e2d26203f8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:48.216027 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-da48e410-30bf-40d0-8dea-08e2d26203f8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:48.216666 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-da48e410-30bf-40d0-8dea-08e2d26203f8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:48.217553 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-da48e410-30bf-40d0-8dea-08e2d26203f8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:48.218176 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-da48e410-30bf-40d0-8dea-08e2d26203f8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:48.218818 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-da48e410-30bf-40d0-8dea-08e2d26203f8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:48.367958 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-da48e410-30bf-40d0-8dea-08e2d26203f8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:48.378088 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-da48e410-30bf-40d0-8dea-08e2d26203f8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:48.379718 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-da48e410-30bf-40d0-8dea-08e2d26203f8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:48.381251 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-da48e410-30bf-40d0-8dea-08e2d26203f8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b" status: 200 len: 1407 microversion: 2.20 time: 0.179718 Aug 11 11:08:48.382000 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 322/665] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:08:48 2022] GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b => generated 1407 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:08:49.405203 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-1d1d0314-ce35-4f9c-87b2-63569cbfb20e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:08:49.405907 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-1d1d0314-ce35-4f9c-87b2-63569cbfb20e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: ab871db0-6362-4dd3-b29c-b513351e027b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:08:49.418020 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1d1d0314-ce35-4f9c-87b2-63569cbfb20e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:49.419726 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1d1d0314-ce35-4f9c-87b2-63569cbfb20e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:49.421087 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1d1d0314-ce35-4f9c-87b2-63569cbfb20e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:49.422011 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1d1d0314-ce35-4f9c-87b2-63569cbfb20e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:49.422653 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1d1d0314-ce35-4f9c-87b2-63569cbfb20e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:49.423079 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1d1d0314-ce35-4f9c-87b2-63569cbfb20e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:49.671472 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-1d1d0314-ce35-4f9c-87b2-63569cbfb20e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:49.680337 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-1d1d0314-ce35-4f9c-87b2-63569cbfb20e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:49.681835 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-1d1d0314-ce35-4f9c-87b2-63569cbfb20e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:49.682998 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-1d1d0314-ce35-4f9c-87b2-63569cbfb20e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b" status: 200 len: 1599 microversion: 2.20 time: 0.283124 Aug 11 11:08:49.683737 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 344/666] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:08:49 2022] GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b => generated 1599 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:08:49.705494 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-9683a2a3-fa89-4913-89a6-80b0c7613d2c tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:08:49.706688 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-9683a2a3-fa89-4913-89a6-80b0c7613d2c tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: ab871db0-6362-4dd3-b29c-b513351e027b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:08:49.713002 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9683a2a3-fa89-4913-89a6-80b0c7613d2c tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:49.713487 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9683a2a3-fa89-4913-89a6-80b0c7613d2c tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:49.714153 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9683a2a3-fa89-4913-89a6-80b0c7613d2c tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:49.714871 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9683a2a3-fa89-4913-89a6-80b0c7613d2c tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:49.715328 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9683a2a3-fa89-4913-89a6-80b0c7613d2c tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:49.715754 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9683a2a3-fa89-4913-89a6-80b0c7613d2c tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:49.829179 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-9683a2a3-fa89-4913-89a6-80b0c7613d2c tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.127453 Aug 11 11:08:49.849094 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 323/667] 10.222.0.48 () {60 vars in 1316 bytes} [Thu Aug 11 11:08:49 2022] GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b/os-interface => generated 284 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 11:08:50.801484 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-9d9037c0-5a70-4b14-8ced-0b9ee6baf379 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:08:50.803697 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-9d9037c0-5a70-4b14-8ced-0b9ee6baf379 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:08:50.810352 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9d9037c0-5a70-4b14-8ced-0b9ee6baf379 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:50.810855 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9d9037c0-5a70-4b14-8ced-0b9ee6baf379 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:50.819500 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9d9037c0-5a70-4b14-8ced-0b9ee6baf379 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:50.819500 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9d9037c0-5a70-4b14-8ced-0b9ee6baf379 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:50.819500 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9d9037c0-5a70-4b14-8ced-0b9ee6baf379 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:50.819500 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9d9037c0-5a70-4b14-8ced-0b9ee6baf379 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:50.857620 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-9d9037c0-5a70-4b14-8ced-0b9ee6baf379 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048044 Aug 11 11:08:50.857620 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 345/668] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Aug 11 11:08:50 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 11 11:08:50.957808 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-3b28d862-cc59-43af-afc5-cabb4df2aac5 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:08:50.958890 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-3b28d862-cc59-43af-afc5-cabb4df2aac5 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:08:50.966774 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3b28d862-cc59-43af-afc5-cabb4df2aac5 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:50.967523 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3b28d862-cc59-43af-afc5-cabb4df2aac5 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:50.968235 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3b28d862-cc59-43af-afc5-cabb4df2aac5 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:50.969132 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3b28d862-cc59-43af-afc5-cabb4df2aac5 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:50.969903 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3b28d862-cc59-43af-afc5-cabb4df2aac5 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:50.971319 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3b28d862-cc59-43af-afc5-cabb4df2aac5 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:51.000310 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-3b28d862-cc59-43af-afc5-cabb4df2aac5 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Going to try to terminate instance {{(pid=121231) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 11 11:08:51.046584 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-2fafe83e-9890-4ab1-9e41-5580a591babb req-f594c985-29ad-45cb-87f6-e567bdf618ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab871db0-6362-4dd3-b29c-b513351e027b", "tag": "1f4049ad-be47-41fe-a43f-26460abf19d8"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:08:51.069684 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-2fafe83e-9890-4ab1-9e41-5580a591babb req-f594c985-29ad-45cb-87f6-e567bdf618ff service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:51.072885 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-2fafe83e-9890-4ab1-9e41-5580a591babb req-f594c985-29ad-45cb-87f6-e567bdf618ff service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:51.073732 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-2fafe83e-9890-4ab1-9e41-5580a591babb req-f594c985-29ad-45cb-87f6-e567bdf618ff service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:51.087671 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-2fafe83e-9890-4ab1-9e41-5580a591babb req-f594c985-29ad-45cb-87f6-e567bdf618ff service nova] Creating event network-changed:1f4049ad-be47-41fe-a43f-26460abf19d8 for instance ab871db0-6362-4dd3-b29c-b513351e027b on hv-cinder-82002 Aug 11 11:08:51.095103 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-2fafe83e-9890-4ab1-9e41-5580a591babb req-f594c985-29ad-45cb-87f6-e567bdf618ff service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054491 Aug 11 11:08:51.096336 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 346/669] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:08:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:08:51.433917 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-3b28d862-cc59-43af-afc5-cabb4df2aac5 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "DELETE /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 204 len: 0 microversion: 2.1 time: 0.480759 Aug 11 11:08:51.435224 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 324/670] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Aug 11 11:08:50 2022] DELETE /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 11 11:08:51.452007 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-4756e6c4-0ee9-4e34-953e-86cff03e0455 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:08:51.453140 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-4756e6c4-0ee9-4e34-953e-86cff03e0455 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:08:51.487400 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4756e6c4-0ee9-4e34-953e-86cff03e0455 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:51.488261 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4756e6c4-0ee9-4e34-953e-86cff03e0455 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:51.489376 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4756e6c4-0ee9-4e34-953e-86cff03e0455 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:51.490922 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4756e6c4-0ee9-4e34-953e-86cff03e0455 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:51.493608 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4756e6c4-0ee9-4e34-953e-86cff03e0455 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:51.495511 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4756e6c4-0ee9-4e34-953e-86cff03e0455 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:51.567226 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-b3d54c5d-1cf6-4589-801e-3e5e21afe8ba tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:08:51.568125 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-b3d54c5d-1cf6-4589-801e-3e5e21afe8ba tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 481c1d02-4070-4d58-8be2-438cd1a68eb5] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:08:51.586264 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b3d54c5d-1cf6-4589-801e-3e5e21afe8ba tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:51.591073 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b3d54c5d-1cf6-4589-801e-3e5e21afe8ba tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:51.592538 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b3d54c5d-1cf6-4589-801e-3e5e21afe8ba tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:51.593501 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b3d54c5d-1cf6-4589-801e-3e5e21afe8ba tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:51.594186 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b3d54c5d-1cf6-4589-801e-3e5e21afe8ba tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:51.594977 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b3d54c5d-1cf6-4589-801e-3e5e21afe8ba tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:51.696272 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-4756e6c4-0ee9-4e34-953e-86cff03e0455 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:51.706529 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-4756e6c4-0ee9-4e34-953e-86cff03e0455 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1674 microversion: 2.1 time: 0.265314 Aug 11 11:08:51.708141 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 347/671] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:08:51 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1674 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:08:51.719273 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.objects.instance [None req-b3d54c5d-1cf6-4589-801e-3e5e21afe8ba tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lazy-loading 'services' on Instance uuid 481c1d02-4070-4d58-8be2-438cd1a68eb5 {{(pid=121231) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 11:08:51.929307 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-b3d54c5d-1cf6-4589-801e-3e5e21afe8ba tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "DELETE /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5/os-volume_attachments/ee369e49-b9bc-4046-b528-2b78a44b8f4e" status: 202 len: 0 microversion: 2.1 time: 0.368183 Aug 11 11:08:51.929905 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 325/672] 10.222.0.48 () {58 vars in 1416 bytes} [Thu Aug 11 11:08:51 2022] DELETE /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5/os-volume_attachments/ee369e49-b9bc-4046-b528-2b78a44b8f4e => generated 0 bytes in 374 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 11:08:51.938702 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-89f143ae-80c7-4f4e-b259-c7ce1297e222 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:08:51.941357 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-89f143ae-80c7-4f4e-b259-c7ce1297e222 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 481c1d02-4070-4d58-8be2-438cd1a68eb5] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:08:51.947995 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-89f143ae-80c7-4f4e-b259-c7ce1297e222 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:51.948724 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-89f143ae-80c7-4f4e-b259-c7ce1297e222 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:51.949454 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-89f143ae-80c7-4f4e-b259-c7ce1297e222 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:51.950400 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-89f143ae-80c7-4f4e-b259-c7ce1297e222 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:51.950860 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-89f143ae-80c7-4f4e-b259-c7ce1297e222 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:51.951292 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-89f143ae-80c7-4f4e-b259-c7ce1297e222 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:51.982544 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-89f143ae-80c7-4f4e-b259-c7ce1297e222 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047907 Aug 11 11:08:51.983260 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 348/673] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Aug 11 11:08:51 2022] GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:08:52.729733 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-a9fd0ec7-5e27-4ad4-816c-fea298b64c20 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:08:52.730434 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-a9fd0ec7-5e27-4ad4-816c-fea298b64c20 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:08:52.733305 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:08:52.740282 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a9fd0ec7-5e27-4ad4-816c-fea298b64c20 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:52.740771 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a9fd0ec7-5e27-4ad4-816c-fea298b64c20 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:52.741207 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a9fd0ec7-5e27-4ad4-816c-fea298b64c20 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:52.741952 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a9fd0ec7-5e27-4ad4-816c-fea298b64c20 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:52.742430 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a9fd0ec7-5e27-4ad4-816c-fea298b64c20 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:52.742856 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a9fd0ec7-5e27-4ad4-816c-fea298b64c20 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:52.916273 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-a9fd0ec7-5e27-4ad4-816c-fea298b64c20 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:52.938248 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-a9fd0ec7-5e27-4ad4-816c-fea298b64c20 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1674 microversion: 2.1 time: 0.212611 Aug 11 11:08:52.944515 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 326/674] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:08:52 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1674 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:08:52.996808 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-8992bfe1-3d32-4276-9dd7-29f7b3967e2b tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:08:52.999054 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-8992bfe1-3d32-4276-9dd7-29f7b3967e2b tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 481c1d02-4070-4d58-8be2-438cd1a68eb5] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:08:53.007248 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_api:SELECT=58,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:08:53.009819 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8992bfe1-3d32-4276-9dd7-29f7b3967e2b tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:53.010539 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8992bfe1-3d32-4276-9dd7-29f7b3967e2b tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:53.016580 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8992bfe1-3d32-4276-9dd7-29f7b3967e2b tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:53.016580 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8992bfe1-3d32-4276-9dd7-29f7b3967e2b tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:53.016580 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8992bfe1-3d32-4276-9dd7-29f7b3967e2b tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:53.016580 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8992bfe1-3d32-4276-9dd7-29f7b3967e2b tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:53.050864 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-8992bfe1-3d32-4276-9dd7-29f7b3967e2b tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059047 Aug 11 11:08:53.051592 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 349/675] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Aug 11 11:08:52 2022] GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:08:53.965248 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-0c5f1867-50ac-4aaa-b198-e962a5d15f36 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:08:53.967397 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-0c5f1867-50ac-4aaa-b198-e962a5d15f36 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:08:53.979090 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0c5f1867-50ac-4aaa-b198-e962a5d15f36 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:53.980393 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0c5f1867-50ac-4aaa-b198-e962a5d15f36 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:53.981008 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0c5f1867-50ac-4aaa-b198-e962a5d15f36 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:53.982212 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0c5f1867-50ac-4aaa-b198-e962a5d15f36 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:53.982912 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0c5f1867-50ac-4aaa-b198-e962a5d15f36 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:53.983596 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0c5f1867-50ac-4aaa-b198-e962a5d15f36 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:54.064133 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-9a8af2e6-28b8-45e0-9934-fa95a160b502 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:08:54.066746 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-9a8af2e6-28b8-45e0-9934-fa95a160b502 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 481c1d02-4070-4d58-8be2-438cd1a68eb5] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:08:54.076426 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9a8af2e6-28b8-45e0-9934-fa95a160b502 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:54.077778 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9a8af2e6-28b8-45e0-9934-fa95a160b502 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:54.078417 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9a8af2e6-28b8-45e0-9934-fa95a160b502 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:54.079798 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9a8af2e6-28b8-45e0-9934-fa95a160b502 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:54.080423 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9a8af2e6-28b8-45e0-9934-fa95a160b502 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:54.081017 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9a8af2e6-28b8-45e0-9934-fa95a160b502 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:54.087536 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=100 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:08:54.118894 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-9a8af2e6-28b8-45e0-9934-fa95a160b502 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059766 Aug 11 11:08:54.120151 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 350/676] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Aug 11 11:08:54 2022] GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:08:54.265969 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-0c5f1867-50ac-4aaa-b198-e962a5d15f36 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:54.322678 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-0c5f1867-50ac-4aaa-b198-e962a5d15f36 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1674 microversion: 2.1 time: 0.359169 Aug 11 11:08:54.335787 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 327/677] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:08:53 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1674 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:08:55.133972 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-f8c146e3-ac4e-4a2a-939f-046758db4a55 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:08:55.139078 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-f8c146e3-ac4e-4a2a-939f-046758db4a55 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 481c1d02-4070-4d58-8be2-438cd1a68eb5] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:08:55.153000 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f8c146e3-ac4e-4a2a-939f-046758db4a55 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:55.153825 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f8c146e3-ac4e-4a2a-939f-046758db4a55 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:55.155276 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f8c146e3-ac4e-4a2a-939f-046758db4a55 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:55.156457 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f8c146e3-ac4e-4a2a-939f-046758db4a55 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:55.157123 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f8c146e3-ac4e-4a2a-939f-046758db4a55 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:55.157985 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f8c146e3-ac4e-4a2a-939f-046758db4a55 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:55.204150 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-f8c146e3-ac4e-4a2a-939f-046758db4a55 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.077352 Aug 11 11:08:55.205467 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 351/678] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Aug 11 11:08:55 2022] GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5/os-volume_attachments => generated 25 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 11 11:08:55.316928 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-0ff0a08a-a888-410f-b5cd-65b60bc26fe8 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:08:55.317427 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-0ff0a08a-a888-410f-b5cd-65b60bc26fe8 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 481c1d02-4070-4d58-8be2-438cd1a68eb5] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:08:55.326188 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0ff0a08a-a888-410f-b5cd-65b60bc26fe8 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:55.327212 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0ff0a08a-a888-410f-b5cd-65b60bc26fe8 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:55.330491 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0ff0a08a-a888-410f-b5cd-65b60bc26fe8 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:55.331952 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0ff0a08a-a888-410f-b5cd-65b60bc26fe8 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:55.332628 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0ff0a08a-a888-410f-b5cd-65b60bc26fe8 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:55.333291 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0ff0a08a-a888-410f-b5cd-65b60bc26fe8 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:55.346381 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-849ce940-190e-4054-a0f3-4fbc84a93f78 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:08:55.346985 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-849ce940-190e-4054-a0f3-4fbc84a93f78 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:08:55.363644 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-849ce940-190e-4054-a0f3-4fbc84a93f78 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:55.364252 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-849ce940-190e-4054-a0f3-4fbc84a93f78 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:55.364698 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-849ce940-190e-4054-a0f3-4fbc84a93f78 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:55.365471 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-849ce940-190e-4054-a0f3-4fbc84a93f78 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:55.366014 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-849ce940-190e-4054-a0f3-4fbc84a93f78 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:55.366700 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-849ce940-190e-4054-a0f3-4fbc84a93f78 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:55.391672 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-0ff0a08a-a888-410f-b5cd-65b60bc26fe8 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 481c1d02-4070-4d58-8be2-438cd1a68eb5] Going to try to terminate instance {{(pid=121231) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 11 11:08:55.585677 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-849ce940-190e-4054-a0f3-4fbc84a93f78 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:55.599751 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-849ce940-190e-4054-a0f3-4fbc84a93f78 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1607 microversion: 2.1 time: 0.259170 Aug 11 11:08:55.602100 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 352/679] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:08:55 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1607 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:08:55.746428 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-0ff0a08a-a888-410f-b5cd-65b60bc26fe8 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "DELETE /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5" status: 204 len: 0 microversion: 2.1 time: 0.424017 Aug 11 11:08:55.746428 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 328/680] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Aug 11 11:08:55 2022] DELETE /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 11 11:08:55.845786 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-a7761a50-aa9d-4548-b862-ca6acaa33ae2 req-c862b82e-ba6a-4055-94a1-ee65272d29f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1797716b-0533-42be-8c06-750959aaf935", "name": "network-vif-deleted", "tag": "6848a700-8424-47d3-8492-918f43aa51ad"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:08:55.868157 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-a7761a50-aa9d-4548-b862-ca6acaa33ae2 req-c862b82e-ba6a-4055-94a1-ee65272d29f1 service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:55.875800 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-a7761a50-aa9d-4548-b862-ca6acaa33ae2 req-c862b82e-ba6a-4055-94a1-ee65272d29f1 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:55.876719 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-a7761a50-aa9d-4548-b862-ca6acaa33ae2 req-c862b82e-ba6a-4055-94a1-ee65272d29f1 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:55.906235 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-a7761a50-aa9d-4548-b862-ca6acaa33ae2 req-c862b82e-ba6a-4055-94a1-ee65272d29f1 service nova] Creating event network-vif-deleted:6848a700-8424-47d3-8492-918f43aa51ad for instance 1797716b-0533-42be-8c06-750959aaf935 on hv-cinder-82002 Aug 11 11:08:55.936007 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-a7761a50-aa9d-4548-b862-ca6acaa33ae2 req-c862b82e-ba6a-4055-94a1-ee65272d29f1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096009 Aug 11 11:08:55.937436 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 329/681] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:08:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 11:08:56.254242 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-fed7a8f2-3e4f-4c6f-b272-a3fe8a67ecfc tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:08:56.254973 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-fed7a8f2-3e4f-4c6f-b272-a3fe8a67ecfc tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 481c1d02-4070-4d58-8be2-438cd1a68eb5] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:08:56.265784 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fed7a8f2-3e4f-4c6f-b272-a3fe8a67ecfc tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:56.270488 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fed7a8f2-3e4f-4c6f-b272-a3fe8a67ecfc tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:56.271035 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fed7a8f2-3e4f-4c6f-b272-a3fe8a67ecfc tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:56.271896 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fed7a8f2-3e4f-4c6f-b272-a3fe8a67ecfc tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:56.272590 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fed7a8f2-3e4f-4c6f-b272-a3fe8a67ecfc tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:56.273223 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fed7a8f2-3e4f-4c6f-b272-a3fe8a67ecfc tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:56.579498 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-fed7a8f2-3e4f-4c6f-b272-a3fe8a67ecfc tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:56.592734 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-fed7a8f2-3e4f-4c6f-b272-a3fe8a67ecfc tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5" status: 200 len: 1688 microversion: 2.1 time: 0.849907 Aug 11 11:08:56.594130 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 353/682] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:08:55 2022] GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5 => generated 1688 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:08:56.629848 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-0f9c9da3-759a-436b-98e0-b32ca674d994 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:08:56.636088 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-0f9c9da3-759a-436b-98e0-b32ca674d994 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:08:56.644653 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0f9c9da3-759a-436b-98e0-b32ca674d994 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:56.645440 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0f9c9da3-759a-436b-98e0-b32ca674d994 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:56.646058 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0f9c9da3-759a-436b-98e0-b32ca674d994 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:56.646770 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0f9c9da3-759a-436b-98e0-b32ca674d994 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:56.647438 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0f9c9da3-759a-436b-98e0-b32ca674d994 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:56.648046 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0f9c9da3-759a-436b-98e0-b32ca674d994 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:56.732133 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-0f9c9da3-759a-436b-98e0-b32ca674d994 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:56.742118 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-0f9c9da3-759a-436b-98e0-b32ca674d994 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1607 microversion: 2.1 time: 0.121327 Aug 11 11:08:56.742696 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 330/683] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:08:56 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1607 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:08:57.296176 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-1dc2be48-77f7-4d97-906b-284183b7bd20 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1737073509"}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:08:57.297357 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-1dc2be48-77f7-4d97-906b-284183b7bd20 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] [instance: 3794302e-1657-4edd-9e15-a78592597d5b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:08:57.308921 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1dc2be48-77f7-4d97-906b-284183b7bd20 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:57.310174 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1dc2be48-77f7-4d97-906b-284183b7bd20 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:57.310867 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1dc2be48-77f7-4d97-906b-284183b7bd20 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:57.311990 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1dc2be48-77f7-4d97-906b-284183b7bd20 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:57.312659 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1dc2be48-77f7-4d97-906b-284183b7bd20 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:57.313306 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1dc2be48-77f7-4d97-906b-284183b7bd20 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:57.539469 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.network.security_group_api [None req-1dc2be48-77f7-4d97-906b-284183b7bd20 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Removing security group 977b2bc8-2a1a-4c5a-b002-d610fd87a560 from port 8d6a01cf-8904-414f-b58d-2be53d6e73d1 Aug 11 11:08:57.615011 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-bf3f698a-e0df-415e-9a22-5fb601a66a34 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:08:57.615627 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-bf3f698a-e0df-415e-9a22-5fb601a66a34 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 481c1d02-4070-4d58-8be2-438cd1a68eb5] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:08:57.631352 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-bf3f698a-e0df-415e-9a22-5fb601a66a34 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:57.632004 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-bf3f698a-e0df-415e-9a22-5fb601a66a34 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:57.632338 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-bf3f698a-e0df-415e-9a22-5fb601a66a34 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:57.633041 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-bf3f698a-e0df-415e-9a22-5fb601a66a34 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:57.633498 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-bf3f698a-e0df-415e-9a22-5fb601a66a34 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:57.633928 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-bf3f698a-e0df-415e-9a22-5fb601a66a34 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:57.967470 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-bf3f698a-e0df-415e-9a22-5fb601a66a34 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:57.975901 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-bf3f698a-e0df-415e-9a22-5fb601a66a34 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5" status: 200 len: 1688 microversion: 2.1 time: 0.365256 Aug 11 11:08:57.976481 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 331/684] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:08:57 2022] GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5 => generated 1688 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:08:57.981582 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-b4082c90-6817-4e53-93c4-bf97c2d404f9 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:08:57.982432 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-b4082c90-6817-4e53-93c4-bf97c2d404f9 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:08:57.989927 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b4082c90-6817-4e53-93c4-bf97c2d404f9 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:57.990672 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b4082c90-6817-4e53-93c4-bf97c2d404f9 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:57.994208 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b4082c90-6817-4e53-93c4-bf97c2d404f9 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:57.994208 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b4082c90-6817-4e53-93c4-bf97c2d404f9 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:57.994208 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b4082c90-6817-4e53-93c4-bf97c2d404f9 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:57.994208 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b4082c90-6817-4e53-93c4-bf97c2d404f9 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:58.115881 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-b4082c90-6817-4e53-93c4-bf97c2d404f9 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:58.123734 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-b4082c90-6817-4e53-93c4-bf97c2d404f9 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1607 microversion: 2.1 time: 0.145910 Aug 11 11:08:58.124349 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 332/685] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:08:57 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1607 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:08:58.343968 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-1dc2be48-77f7-4d97-906b-284183b7bd20 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] 10.222.0.48 "POST /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b/action" status: 202 len: 0 microversion: 2.1 time: 1.051822 Aug 11 11:08:58.348592 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 354/686] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Aug 11 11:08:57 2022] POST /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b/action => generated 0 bytes in 1057 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 11:08:58.359796 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-7c665baa-1fb5-4e60-a042-e187e9961a49 req-22e59d3e-9f5b-4b20-ad4c-28b51af674b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3794302e-1657-4edd-9e15-a78592597d5b", "tag": "8d6a01cf-8904-414f-b58d-2be53d6e73d1"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:08:58.371306 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-7c665baa-1fb5-4e60-a042-e187e9961a49 req-22e59d3e-9f5b-4b20-ad4c-28b51af674b6 service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:58.372189 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-7c665baa-1fb5-4e60-a042-e187e9961a49 req-22e59d3e-9f5b-4b20-ad4c-28b51af674b6 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:58.372864 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-7c665baa-1fb5-4e60-a042-e187e9961a49 req-22e59d3e-9f5b-4b20-ad4c-28b51af674b6 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:58.389159 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-7c665baa-1fb5-4e60-a042-e187e9961a49 req-22e59d3e-9f5b-4b20-ad4c-28b51af674b6 service nova] Creating event network-changed:8d6a01cf-8904-414f-b58d-2be53d6e73d1 for instance 3794302e-1657-4edd-9e15-a78592597d5b on hv-cinder-82002 Aug 11 11:08:58.400258 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-7c665baa-1fb5-4e60-a042-e187e9961a49 req-22e59d3e-9f5b-4b20-ad4c-28b51af674b6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045952 Aug 11 11:08:58.402486 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 333/687] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:08:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:08:58.693837 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 11:08:58.693837 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Thu Aug 11 11:08:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 11 11:08:58.998048 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-e04d48e0-87f0-4c82-8e26-328013a4a883 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:08:58.998796 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-e04d48e0-87f0-4c82-8e26-328013a4a883 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 481c1d02-4070-4d58-8be2-438cd1a68eb5] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:08:59.005921 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e04d48e0-87f0-4c82-8e26-328013a4a883 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:59.006487 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e04d48e0-87f0-4c82-8e26-328013a4a883 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:59.007078 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e04d48e0-87f0-4c82-8e26-328013a4a883 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:59.007995 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e04d48e0-87f0-4c82-8e26-328013a4a883 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:59.013846 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e04d48e0-87f0-4c82-8e26-328013a4a883 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:59.017905 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e04d48e0-87f0-4c82-8e26-328013a4a883 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:59.145494 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-39a2ed8c-c373-4fd6-b037-d26ec92424f6 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:08:59.146195 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-39a2ed8c-c373-4fd6-b037-d26ec92424f6 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:08:59.155129 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-39a2ed8c-c373-4fd6-b037-d26ec92424f6 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:59.155993 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-39a2ed8c-c373-4fd6-b037-d26ec92424f6 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:59.156630 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-39a2ed8c-c373-4fd6-b037-d26ec92424f6 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:59.158077 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-39a2ed8c-c373-4fd6-b037-d26ec92424f6 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:08:59.158732 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-39a2ed8c-c373-4fd6-b037-d26ec92424f6 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:08:59.159388 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-39a2ed8c-c373-4fd6-b037-d26ec92424f6 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:08:59.183385 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:08:59.280846 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-39a2ed8c-c373-4fd6-b037-d26ec92424f6 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:59.299569 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-39a2ed8c-c373-4fd6-b037-d26ec92424f6 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 200 len: 1607 microversion: 2.1 time: 0.153145 Aug 11 11:08:59.300269 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 334/688] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:08:59 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 1607 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:08:59.361120 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-e04d48e0-87f0-4c82-8e26-328013a4a883 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:08:59.373157 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-e04d48e0-87f0-4c82-8e26-328013a4a883 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5" status: 200 len: 1688 microversion: 2.1 time: 0.378741 Aug 11 11:08:59.387826 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 355/689] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:08:58 2022] GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5 => generated 1688 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:09:00.322429 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-2b16c95a-9315-4d5d-b064-f29e7a7d08a1 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:00.323642 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-2b16c95a-9315-4d5d-b064-f29e7a7d08a1 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:00.331852 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2b16c95a-9315-4d5d-b064-f29e7a7d08a1 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:00.332824 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2b16c95a-9315-4d5d-b064-f29e7a7d08a1 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:00.333422 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2b16c95a-9315-4d5d-b064-f29e7a7d08a1 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:00.334257 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2b16c95a-9315-4d5d-b064-f29e7a7d08a1 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:00.334857 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2b16c95a-9315-4d5d-b064-f29e7a7d08a1 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:00.335273 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2b16c95a-9315-4d5d-b064-f29e7a7d08a1 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:00.354230 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.wsgi [None req-2b16c95a-9315-4d5d-b064-f29e7a7d08a1 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] HTTP exception thrown: Instance 1797716b-0533-42be-8c06-750959aaf935 could not be found. Aug 11 11:09:00.356187 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-2b16c95a-9315-4d5d-b064-f29e7a7d08a1 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Request method failure captured: Aug 11 11:09:00.356187 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: request: GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 HTTP/1.1 Aug 11 11:09:00.356187 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Accept: application/json Aug 11 11:09:00.356187 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Accept-Encoding: identity Aug 11 11:09:00.356187 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Connection: close Aug 11 11:09:00.356187 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Content-Length: 0 Aug 11 11:09:00.356187 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Content-Type: application/json Aug 11 11:09:00.356187 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Host: 10.222.0.48 Aug 11 11:09:00.356187 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Openstack-System-Scope: None Aug 11 11:09:00.356187 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: User-Agent: python-urllib3/1.26.11 Aug 11 11:09:00.356187 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Auth-Token: gAAAAABi9OIRfnJpFtGQ5A6DGD3tzjjnbj8hoix-U8-zpHZo5hSEXhAqzDd8qOwUgjdkMuC_FgAY9kfkVldA2-CRi90KY2HEKbLPuClKRqK5ss7wuTuVTSkYcnzqSw74Y-caXwLJ1gamk4Xj2jETroJCKWaJM9wkh4X4EjWZZSdEmT48WtGyxTI Aug 11 11:09:00.356187 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Domain-Id: None Aug 11 11:09:00.356187 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Domain-Name: None Aug 11 11:09:00.356187 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Identity-Status: Confirmed Aug 11 11:09:00.356187 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Is-Admin-Project: True Aug 11 11:09:00.356187 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Domain-Id: default Aug 11 11:09:00.356187 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Domain-Name: Default Aug 11 11:09:00.356187 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Id: b0b3799012d24fad98d155e3b000fc22 Aug 11 11:09:00.356187 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Name: tempest-AttachVolumeTestJSON-1625266365 Aug 11 11:09:00.356187 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Role: reader,member Aug 11 11:09:00.356187 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Roles: reader,member Aug 11 11:09:00.357699 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b0b3799012d24fad98d155e3b000fc22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b0b3799012d24fad98d155e3b000fc22"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b0b3799012d24fad98d155e3b000fc22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b0b3799012d24fad98d155e3b000fc22", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] Aug 11 11:09:00.357699 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant: tempest-AttachVolumeTestJSON-1625266365 Aug 11 11:09:00.357699 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant-Id: b0b3799012d24fad98d155e3b000fc22 Aug 11 11:09:00.357699 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1625266365 Aug 11 11:09:00.357699 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User: tempest-AttachVolumeTestJSON-1625266365-project Aug 11 11:09:00.357699 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Domain-Id: default Aug 11 11:09:00.357699 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Domain-Name: Default Aug 11 11:09:00.357699 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Id: bb18a00d44ed4af186bdc589e1e14e22 Aug 11 11:09:00.357699 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Name: tempest-AttachVolumeTestJSON-1625266365-project Aug 11 11:09:00.357699 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: method: > Aug 11 11:09:00.357699 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: exception: Instance 1797716b-0533-42be-8c06-750959aaf935 could not be found. Aug 11 11:09:00.357699 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: action_args: {'id': '1797716b-0533-42be-8c06-750959aaf935'} Aug 11 11:09:00.359229 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 11:09:00.359229 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:09:00.359229 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 11:09:00.359229 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 11:09:00.359229 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 11:09:00.359229 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 11:09:00.359229 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 11:09:00.359229 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 11:09:00.359229 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 11:09:00.359229 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 11:09:00.359229 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1797716b-0533-42be-8c06-750959aaf935 could not be found. Aug 11 11:09:00.359229 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:09:00.359229 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:09:00.359229 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:09:00.359229 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:09:00.359229 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:09:00.359229 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:09:00.359229 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 11:09:00.359229 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 11:09:00.359229 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 11:09:00.360781 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 11:09:00.360781 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 11:09:00.360781 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 11:09:00.360781 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 11:09:00.360781 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 11:09:00.360781 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 11:09:00.360781 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 11:09:00.360781 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1797716b-0533-42be-8c06-750959aaf935 could not be found. Aug 11 11:09:00.360781 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:09:00.360781 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:09:00.360781 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:09:00.360781 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:09:00.360781 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:09:00.360781 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:09:00.360781 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 11:09:00.360781 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 11:09:00.360781 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1797716b-0533-42be-8c06-750959aaf935 could not be found. Aug 11 11:09:00.360781 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:09:00.362196 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-2b16c95a-9315-4d5d-b064-f29e7a7d08a1 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Returning 404 to user: Instance 1797716b-0533-42be-8c06-750959aaf935 could not be found. {{(pid=121231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 11:09:00.362196 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-2b16c95a-9315-4d5d-b064-f29e7a7d08a1 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 404 len: 111 microversion: 2.1 time: 0.039480 Aug 11 11:09:00.362196 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 335/690] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:09:00 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 11:09:00.366671 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-cd2681f8-2066-4828-952b-c76be33eb7f5 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '.version_select at 0x7faab0b21b80>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:00.395151 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-f8a32c22-605b-482b-8dd9-2cc0a5e64446 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:00.395943 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-f8a32c22-605b-482b-8dd9-2cc0a5e64446 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 481c1d02-4070-4d58-8be2-438cd1a68eb5] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:00.403812 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f8a32c22-605b-482b-8dd9-2cc0a5e64446 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:00.404498 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f8a32c22-605b-482b-8dd9-2cc0a5e64446 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:00.405151 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f8a32c22-605b-482b-8dd9-2cc0a5e64446 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:00.406005 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f8a32c22-605b-482b-8dd9-2cc0a5e64446 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:00.406653 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f8a32c22-605b-482b-8dd9-2cc0a5e64446 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:00.407946 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f8a32c22-605b-482b-8dd9-2cc0a5e64446 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:00.441691 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-cd2681f8-2066-4828-952b-c76be33eb7f5 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-839198739" status: 202 len: 0 microversion: 2.1 time: 0.078767 Aug 11 11:09:00.447434 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 356/691] 10.222.0.48 () {58 vars in 1218 bytes} [Thu Aug 11 11:09:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-839198739 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 11:09:00.663613 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-f8a32c22-605b-482b-8dd9-2cc0a5e64446 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:00.699391 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-11c3e4d7-7410-41c8-a5fb-f21bc92bad44 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Action: 'create', calling method: .version_select at 0x7faab0aedee0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-614059539", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJbELecYbj1xADK/qoWRGGUY6mTexRynImnbgh5K0apB8Vclmc7krFvVq1aM79D+XfmzK9GewThZQksTQ34qBlPZ80qJzJ4SN5Z49WkEjoDIQGQh0lGHk+nlJyOXUc38nA=="}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:09:00.706693 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-f8a32c22-605b-482b-8dd9-2cc0a5e64446 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5" status: 200 len: 1688 microversion: 2.1 time: 0.315950 Aug 11 11:09:00.708406 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 336/692] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:09:00 2022] GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5 => generated 1688 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:09:00.733130 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-11c3e4d7-7410-41c8-a5fb-f21bc92bad44 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Getting quotas for project b1d394882f294c6283721bcc6f8ff04d. Resources: {'key_pairs'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 11:09:00.737936 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-11c3e4d7-7410-41c8-a5fb-f21bc92bad44 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Getting quotas for user 2a9dbe3b7fdd482681b6ab94c26f4e71 and project b1d394882f294c6283721bcc6f8ff04d. Resources: {'key_pairs'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 11:09:00.739743 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-847129f4-0923-471b-8277-d3ca5cbbdefa tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:00.740349 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-847129f4-0923-471b-8277-d3ca5cbbdefa tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] [instance: 3794302e-1657-4edd-9e15-a78592597d5b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:00.752469 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-847129f4-0923-471b-8277-d3ca5cbbdefa tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:00.753597 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-847129f4-0923-471b-8277-d3ca5cbbdefa tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:00.754259 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-847129f4-0923-471b-8277-d3ca5cbbdefa tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:00.755034 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-847129f4-0923-471b-8277-d3ca5cbbdefa tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:00.755811 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-847129f4-0923-471b-8277-d3ca5cbbdefa tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:00.756415 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-847129f4-0923-471b-8277-d3ca5cbbdefa tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:00.823997 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-11c3e4d7-7410-41c8-a5fb-f21bc92bad44 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.262725 Aug 11 11:09:00.825545 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 357/693] 10.222.0.48 () {60 vars in 1159 bytes} [Thu Aug 11 11:09:00 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:09:00.838100 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-811adf6c-dfa0-410a-aab7-ae083c2ec8e1 req-48e35893-8b0e-49ce-9be1-bb0a45731793 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3794302e-1657-4edd-9e15-a78592597d5b", "tag": "8d6a01cf-8904-414f-b58d-2be53d6e73d1"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:09:00.867138 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-811adf6c-dfa0-410a-aab7-ae083c2ec8e1 req-48e35893-8b0e-49ce-9be1-bb0a45731793 service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:00.871072 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.objects.instance [None req-847129f4-0923-471b-8277-d3ca5cbbdefa tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lazy-loading 'services' on Instance uuid 3794302e-1657-4edd-9e15-a78592597d5b {{(pid=121231) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 11:09:00.871237 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-811adf6c-dfa0-410a-aab7-ae083c2ec8e1 req-48e35893-8b0e-49ce-9be1-bb0a45731793 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:00.871589 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-811adf6c-dfa0-410a-aab7-ae083c2ec8e1 req-48e35893-8b0e-49ce-9be1-bb0a45731793 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:00.897572 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-811adf6c-dfa0-410a-aab7-ae083c2ec8e1 req-48e35893-8b0e-49ce-9be1-bb0a45731793 service nova] Creating event network-changed:8d6a01cf-8904-414f-b58d-2be53d6e73d1 for instance 3794302e-1657-4edd-9e15-a78592597d5b on hv-cinder-82002 Aug 11 11:09:00.911512 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-811adf6c-dfa0-410a-aab7-ae083c2ec8e1 req-48e35893-8b0e-49ce-9be1-bb0a45731793 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084376 Aug 11 11:09:00.915477 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 358/694] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:09:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:09:01.111129 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-80296e0f-1f6c-4292-8ae9-62c2ef387434 req-592347d3-cec7-4e9d-a0ec-6f0ca8b00245 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "481c1d02-4070-4d58-8be2-438cd1a68eb5", "name": "network-vif-deleted", "tag": "9c6e465a-0bd3-4725-9e9b-81120495670d"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:09:01.128825 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-80296e0f-1f6c-4292-8ae9-62c2ef387434 req-592347d3-cec7-4e9d-a0ec-6f0ca8b00245 service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:01.129319 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-80296e0f-1f6c-4292-8ae9-62c2ef387434 req-592347d3-cec7-4e9d-a0ec-6f0ca8b00245 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:01.129759 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-80296e0f-1f6c-4292-8ae9-62c2ef387434 req-592347d3-cec7-4e9d-a0ec-6f0ca8b00245 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:01.146686 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-80296e0f-1f6c-4292-8ae9-62c2ef387434 req-592347d3-cec7-4e9d-a0ec-6f0ca8b00245 service nova] Creating event network-vif-deleted:9c6e465a-0bd3-4725-9e9b-81120495670d for instance 481c1d02-4070-4d58-8be2-438cd1a68eb5 on hv-cinder-82002 Aug 11 11:09:01.161005 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-80296e0f-1f6c-4292-8ae9-62c2ef387434 req-592347d3-cec7-4e9d-a0ec-6f0ca8b00245 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055528 Aug 11 11:09:01.162305 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 359/695] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:09:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:09:01.202890 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-847129f4-0923-471b-8277-d3ca5cbbdefa tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] 10.222.0.48 "DELETE /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b/os-volume_attachments/edef24ce-7270-4843-a839-29f9cc7038fe" status: 202 len: 0 microversion: 2.1 time: 0.466485 Aug 11 11:09:01.203529 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 337/696] 10.222.0.48 () {58 vars in 1416 bytes} [Thu Aug 11 11:09:00 2022] DELETE /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b/os-volume_attachments/edef24ce-7270-4843-a839-29f9cc7038fe => generated 0 bytes in 469 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 11:09:01.217109 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-afe87510-6c60-48e8-b528-4d69f7a807fa tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:01.225203 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-afe87510-6c60-48e8-b528-4d69f7a807fa tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] [instance: 3794302e-1657-4edd-9e15-a78592597d5b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:01.257499 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-afe87510-6c60-48e8-b528-4d69f7a807fa tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:01.259727 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-afe87510-6c60-48e8-b528-4d69f7a807fa tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:01.260616 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-afe87510-6c60-48e8-b528-4d69f7a807fa tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:01.268844 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-afe87510-6c60-48e8-b528-4d69f7a807fa tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:01.270783 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-afe87510-6c60-48e8-b528-4d69f7a807fa tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:01.273177 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-afe87510-6c60-48e8-b528-4d69f7a807fa tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:01.364712 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-afe87510-6c60-48e8-b528-4d69f7a807fa tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] 10.222.0.48 "GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.156471 Aug 11 11:09:01.368779 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 360/697] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Aug 11 11:09:01 2022] GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b/os-volume_attachments => generated 197 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:09:01.729741 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-7d459401-c46d-4db0-8919-768f86642682 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:01.731323 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-7d459401-c46d-4db0-8919-768f86642682 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 481c1d02-4070-4d58-8be2-438cd1a68eb5] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:01.738400 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7d459401-c46d-4db0-8919-768f86642682 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:01.739279 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7d459401-c46d-4db0-8919-768f86642682 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:01.740003 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7d459401-c46d-4db0-8919-768f86642682 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:01.740965 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7d459401-c46d-4db0-8919-768f86642682 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:01.741643 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7d459401-c46d-4db0-8919-768f86642682 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:01.742291 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7d459401-c46d-4db0-8919-768f86642682 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:01.779440 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7d459401-c46d-4db0-8919-768f86642682 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:01.780318 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7d459401-c46d-4db0-8919-768f86642682 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:01.780971 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7d459401-c46d-4db0-8919-768f86642682 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:01.781658 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.objects.instance [None req-7d459401-c46d-4db0-8919-768f86642682 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lazy-loading 'fault' on Instance uuid 481c1d02-4070-4d58-8be2-438cd1a68eb5 {{(pid=121231) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 11:09:01.805768 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-6352f9a4-54e9-4893-815e-da3ce24c787f tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Action: 'create', calling method: .version_select at 0x7faab0c24b80>, body: {"keypair": {"name": "tempest-keypair-1544748498", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAbhXYud37HjYlqKEJoqIZoQt/M6tUGWquQ5EUZr9wFe13uKVkr3h1QeX1g+iRIvgQ2DPw4hhdcS6xNlYCF9xsUZvcR1emQwRJv+raMj4UqGvwTzaQ1wQrg9hYoAcULiqQ=="}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:09:01.821545 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-6352f9a4-54e9-4893-815e-da3ce24c787f tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Getting quotas for project b0b3799012d24fad98d155e3b000fc22. Resources: {'key_pairs'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 11:09:01.826171 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-6352f9a4-54e9-4893-815e-da3ce24c787f tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Getting quotas for user bb18a00d44ed4af186bdc589e1e14e22 and project b0b3799012d24fad98d155e3b000fc22. Resources: {'key_pairs'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 11:09:01.841963 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-7d459401-c46d-4db0-8919-768f86642682 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:01.852372 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-7d459401-c46d-4db0-8919-768f86642682 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5" status: 200 len: 1335 microversion: 2.1 time: 0.127327 Aug 11 11:09:01.853609 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 338/698] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:09:01 2022] GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5 => generated 1335 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:09:01.980617 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-6352f9a4-54e9-4893-815e-da3ce24c787f tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.178488 Aug 11 11:09:01.981469 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 361/699] 10.222.0.48 () {60 vars in 1159 bytes} [Thu Aug 11 11:09:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:09:02.381570 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-5fee6183-4fcb-44e0-80e8-e2cd819567f9 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:02.383906 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-5fee6183-4fcb-44e0-80e8-e2cd819567f9 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] [instance: 3794302e-1657-4edd-9e15-a78592597d5b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:02.390782 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5fee6183-4fcb-44e0-80e8-e2cd819567f9 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:02.391900 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5fee6183-4fcb-44e0-80e8-e2cd819567f9 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:02.392341 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5fee6183-4fcb-44e0-80e8-e2cd819567f9 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:02.393203 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5fee6183-4fcb-44e0-80e8-e2cd819567f9 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:02.393802 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5fee6183-4fcb-44e0-80e8-e2cd819567f9 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:02.394414 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5fee6183-4fcb-44e0-80e8-e2cd819567f9 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:02.454600 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-5fee6183-4fcb-44e0-80e8-e2cd819567f9 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] 10.222.0.48 "GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077334 Aug 11 11:09:02.455403 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 339/700] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Aug 11 11:09:02 2022] GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:09:02.874339 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-7334baac-46cb-4752-9c1a-3901cf7e2bf0 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:02.875055 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-7334baac-46cb-4752-9c1a-3901cf7e2bf0 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 481c1d02-4070-4d58-8be2-438cd1a68eb5] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:02.883121 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7334baac-46cb-4752-9c1a-3901cf7e2bf0 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:02.883889 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7334baac-46cb-4752-9c1a-3901cf7e2bf0 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:02.885067 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7334baac-46cb-4752-9c1a-3901cf7e2bf0 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:02.885801 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7334baac-46cb-4752-9c1a-3901cf7e2bf0 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:02.886579 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7334baac-46cb-4752-9c1a-3901cf7e2bf0 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:02.887195 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7334baac-46cb-4752-9c1a-3901cf7e2bf0 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:02.906254 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.wsgi [None req-7334baac-46cb-4752-9c1a-3901cf7e2bf0 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] HTTP exception thrown: Instance 481c1d02-4070-4d58-8be2-438cd1a68eb5 could not be found. Aug 11 11:09:02.908433 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-7334baac-46cb-4752-9c1a-3901cf7e2bf0 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Request method failure captured: Aug 11 11:09:02.908433 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: request: GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5 HTTP/1.1 Aug 11 11:09:02.908433 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Accept: application/json Aug 11 11:09:02.908433 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Accept-Encoding: identity Aug 11 11:09:02.908433 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Connection: close Aug 11 11:09:02.908433 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Content-Length: 0 Aug 11 11:09:02.908433 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Content-Type: application/json Aug 11 11:09:02.908433 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Host: 10.222.0.48 Aug 11 11:09:02.908433 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Openstack-System-Scope: None Aug 11 11:09:02.908433 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: User-Agent: python-urllib3/1.26.11 Aug 11 11:09:02.908433 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Auth-Token: gAAAAABi9OIZrQLD9wcn33oOAILRLRgizejVjH27hxki3e7YaqpWc9w5AB6twcQbo6ujH2ticAWA98YJt2oEA_0zpX3GqgJkSqqHfHltxhU9T4SgJ_YQxUiy9cMGURf0wSoT5Vg71mc-C9U7FKhPy_DOheOZskafHmoddANNVZO-sZBS_1qYvI4 Aug 11 11:09:02.908433 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Domain-Id: None Aug 11 11:09:02.908433 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Domain-Name: None Aug 11 11:09:02.908433 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Identity-Status: Confirmed Aug 11 11:09:02.908433 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Is-Admin-Project: True Aug 11 11:09:02.908433 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Domain-Id: default Aug 11 11:09:02.908433 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Domain-Name: Default Aug 11 11:09:02.908433 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Id: e8751d4bd74240db9b57b7e9f788df94 Aug 11 11:09:02.908433 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1157402601 Aug 11 11:09:02.908433 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Role: reader,member Aug 11 11:09:02.908433 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Roles: reader,member Aug 11 11:09:02.910472 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e8751d4bd74240db9b57b7e9f788df94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e8751d4bd74240db9b57b7e9f788df94"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e8751d4bd74240db9b57b7e9f788df94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e8751d4bd74240db9b57b7e9f788df94", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] Aug 11 11:09:02.910472 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1157402601 Aug 11 11:09:02.910472 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Tenant-Id: e8751d4bd74240db9b57b7e9f788df94 Aug 11 11:09:02.910472 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1157402601 Aug 11 11:09:02.910472 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User: tempest-ServerRescueNegativeTestJSON-1157402601-project Aug 11 11:09:02.910472 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Domain-Id: default Aug 11 11:09:02.910472 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Domain-Name: Default Aug 11 11:09:02.910472 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Id: 684d59041e82466d8aad6d2964842bf5 Aug 11 11:09:02.910472 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1157402601-project Aug 11 11:09:02.910472 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: method: > Aug 11 11:09:02.910472 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: exception: Instance 481c1d02-4070-4d58-8be2-438cd1a68eb5 could not be found. Aug 11 11:09:02.910472 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: action_args: {'id': '481c1d02-4070-4d58-8be2-438cd1a68eb5'} Aug 11 11:09:02.911558 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 11:09:02.911558 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:09:02.911558 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 11:09:02.911558 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 11:09:02.911558 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 11:09:02.911558 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 11:09:02.911558 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 11:09:02.911558 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 11:09:02.911558 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 11:09:02.911558 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 11:09:02.911558 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 481c1d02-4070-4d58-8be2-438cd1a68eb5 could not be found. Aug 11 11:09:02.911558 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:09:02.911558 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:09:02.911558 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:09:02.911558 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:09:02.911558 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:09:02.911558 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:09:02.911558 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 11:09:02.911558 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 11:09:02.911558 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 11:09:02.913205 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 11:09:02.913205 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 11:09:02.913205 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 11:09:02.913205 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 11:09:02.913205 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 11:09:02.913205 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 11:09:02.913205 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 11:09:02.913205 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 481c1d02-4070-4d58-8be2-438cd1a68eb5 could not be found. Aug 11 11:09:02.913205 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:09:02.913205 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:09:02.913205 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:09:02.913205 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:09:02.913205 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:09:02.913205 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:09:02.913205 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 11:09:02.913205 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 11:09:02.913205 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 481c1d02-4070-4d58-8be2-438cd1a68eb5 could not be found. Aug 11 11:09:02.913205 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:09:02.914791 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-7334baac-46cb-4752-9c1a-3901cf7e2bf0 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Returning 404 to user: Instance 481c1d02-4070-4d58-8be2-438cd1a68eb5 could not be found. {{(pid=121232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 11:09:02.914791 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-7334baac-46cb-4752-9c1a-3901cf7e2bf0 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5" status: 404 len: 111 microversion: 2.1 time: 0.040375 Aug 11 11:09:02.919035 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-e14575d3-874c-47b5-9187-f95deb791455 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '.version_select at 0x7faab0a09160>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:02.924021 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 362/701] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:09:02 2022] GET /compute/v2.1/servers/481c1d02-4070-4d58-8be2-438cd1a68eb5 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 11:09:03.142967 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-e14575d3-874c-47b5-9187-f95deb791455 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1144576263" status: 202 len: 0 microversion: 2.1 time: 0.228172 Aug 11 11:09:03.143557 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 340/702] 10.222.0.48 () {58 vars in 1221 bytes} [Thu Aug 11 11:09:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1144576263 => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 11:09:03.467359 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-1bafddca-dcbe-4d70-a20b-606833d8993c tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:03.470389 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-1bafddca-dcbe-4d70-a20b-606833d8993c tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] [instance: 3794302e-1657-4edd-9e15-a78592597d5b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:03.476512 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1bafddca-dcbe-4d70-a20b-606833d8993c tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:03.477000 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1bafddca-dcbe-4d70-a20b-606833d8993c tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:03.477434 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1bafddca-dcbe-4d70-a20b-606833d8993c tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:03.478117 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1bafddca-dcbe-4d70-a20b-606833d8993c tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:03.478568 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1bafddca-dcbe-4d70-a20b-606833d8993c tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:03.479025 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1bafddca-dcbe-4d70-a20b-606833d8993c tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:03.537506 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-1bafddca-dcbe-4d70-a20b-606833d8993c tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] 10.222.0.48 "GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.074389 Aug 11 11:09:03.538178 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 363/703] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Aug 11 11:09:03 2022] GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b/os-volume_attachments => generated 25 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 11 11:09:03.550857 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-8b437472-a5eb-4f33-ab6d-ec6aab90c7d2 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:03.551626 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-8b437472-a5eb-4f33-ab6d-ec6aab90c7d2 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] [instance: 3794302e-1657-4edd-9e15-a78592597d5b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:03.559371 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8b437472-a5eb-4f33-ab6d-ec6aab90c7d2 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:03.559989 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8b437472-a5eb-4f33-ab6d-ec6aab90c7d2 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:03.560677 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8b437472-a5eb-4f33-ab6d-ec6aab90c7d2 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:03.561432 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8b437472-a5eb-4f33-ab6d-ec6aab90c7d2 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:03.562275 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8b437472-a5eb-4f33-ab6d-ec6aab90c7d2 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:03.562719 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8b437472-a5eb-4f33-ab6d-ec6aab90c7d2 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:03.654807 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.wsgi [None req-8b437472-a5eb-4f33-ab6d-ec6aab90c7d2 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] HTTP exception thrown: Instance 3794302e-1657-4edd-9e15-a78592597d5b is not attached to volume edef24ce-7270-4843-a839-29f9cc7038fe Aug 11 11:09:03.657492 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-8b437472-a5eb-4f33-ab6d-ec6aab90c7d2 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Request method failure captured: Aug 11 11:09:03.657492 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: request: DELETE /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b/os-volume_attachments/edef24ce-7270-4843-a839-29f9cc7038fe HTTP/1.1 Aug 11 11:09:03.657492 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Accept: application/json Aug 11 11:09:03.657492 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Accept-Encoding: identity Aug 11 11:09:03.657492 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Connection: close Aug 11 11:09:03.657492 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Content-Length: 0 Aug 11 11:09:03.657492 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Content-Type: application/json Aug 11 11:09:03.657492 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Host: 10.222.0.48 Aug 11 11:09:03.657492 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Openstack-System-Scope: None Aug 11 11:09:03.657492 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: User-Agent: python-urllib3/1.26.11 Aug 11 11:09:03.657492 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Auth-Token: gAAAAABi9OKJibBCBi9GM_Z3oi8N6AFQphml8gJGwThjsB2NMCQsd1e1jvAEEpOWAoX5DY_2downfis7q5l_wfJLZbX_ppSjVcgqsG8xnqlluqz3UEpZ7UAZXtbhD2LB_FrwtkJ49E2IsERolf7vcHD8ItDAkoK2vH1pSn_i8zgKKWtc1m6ASNU Aug 11 11:09:03.657492 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Domain-Id: None Aug 11 11:09:03.657492 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Domain-Name: None Aug 11 11:09:03.657492 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Identity-Status: Confirmed Aug 11 11:09:03.657492 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Is-Admin-Project: True Aug 11 11:09:03.657492 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Domain-Id: default Aug 11 11:09:03.657492 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Domain-Name: Default Aug 11 11:09:03.657492 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Id: 233f1c55781b4099be6e250e664c4fb9 Aug 11 11:09:03.657492 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Name: tempest-TestMinimumBasicScenario-1792480745 Aug 11 11:09:03.657492 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Role: reader,member Aug 11 11:09:03.657492 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Roles: reader,member Aug 11 11:09:03.659198 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/233f1c55781b4099be6e250e664c4fb9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/233f1c55781b4099be6e250e664c4fb9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/233f1c55781b4099be6e250e664c4fb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_233f1c55781b4099be6e250e664c4fb9", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] Aug 11 11:09:03.659198 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant: tempest-TestMinimumBasicScenario-1792480745 Aug 11 11:09:03.659198 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant-Id: 233f1c55781b4099be6e250e664c4fb9 Aug 11 11:09:03.659198 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1792480745 Aug 11 11:09:03.659198 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User: tempest-TestMinimumBasicScenario-1792480745-project Aug 11 11:09:03.659198 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Domain-Id: default Aug 11 11:09:03.659198 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Domain-Name: Default Aug 11 11:09:03.659198 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Id: dfaf5a716c5b448f8e1274de2fad307c Aug 11 11:09:03.659198 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Name: tempest-TestMinimumBasicScenario-1792480745-project Aug 11 11:09:03.659198 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: method: > Aug 11 11:09:03.659198 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: exception: Instance 3794302e-1657-4edd-9e15-a78592597d5b is not attached to volume edef24ce-7270-4843-a839-29f9cc7038fe Aug 11 11:09:03.660075 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: action_args: {'server_id': '3794302e-1657-4edd-9e15-a78592597d5b', 'id': 'edef24ce-7270-4843-a839-29f9cc7038fe'} Aug 11 11:09:03.660075 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 11:09:03.660075 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:09:03.660075 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 11 11:09:03.660075 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 11 11:09:03.660075 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 11 11:09:03.660075 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 11 11:09:03.660075 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 11 11:09:03.660075 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 11 11:09:03.660075 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id edef24ce-7270-4843-a839-29f9cc7038fe. Aug 11 11:09:03.660075 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:09:03.660075 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:09:03.660075 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:09:03.660075 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:09:03.660075 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:09:03.660075 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:09:03.660075 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 11:09:03.660075 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 11:09:03.660075 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 11:09:03.664709 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 11:09:03.664709 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 11 11:09:03.664709 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 11 11:09:03.664709 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3794302e-1657-4edd-9e15-a78592597d5b is not attached to volume edef24ce-7270-4843-a839-29f9cc7038fe Aug 11 11:09:03.664709 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:09:03.664709 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:09:03.664709 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:09:03.664709 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:09:03.664709 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:09:03.664709 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:09:03.664709 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 11:09:03.664709 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 11:09:03.664709 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3794302e-1657-4edd-9e15-a78592597d5b is not attached to volume edef24ce-7270-4843-a839-29f9cc7038fe Aug 11 11:09:03.664709 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:09:03.664709 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-8b437472-a5eb-4f33-ab6d-ec6aab90c7d2 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Returning 404 to user: Instance 3794302e-1657-4edd-9e15-a78592597d5b is not attached to volume edef24ce-7270-4843-a839-29f9cc7038fe {{(pid=121231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 11:09:03.675029 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-8b437472-a5eb-4f33-ab6d-ec6aab90c7d2 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] 10.222.0.48 "DELETE /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b/os-volume_attachments/edef24ce-7270-4843-a839-29f9cc7038fe" status: 404 len: 154 microversion: 2.1 time: 0.114770 Aug 11 11:09:03.675029 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 341/704] 10.222.0.48 () {58 vars in 1416 bytes} [Thu Aug 11 11:09:03 2022] DELETE /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b/os-volume_attachments/edef24ce-7270-4843-a839-29f9cc7038fe => generated 154 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 11:09:04.995963 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-f14ff1de-5792-4af5-a4fd-b89bc24478fe tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:04.996499 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-f14ff1de-5792-4af5-a4fd-b89bc24478fe tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] [instance: 3794302e-1657-4edd-9e15-a78592597d5b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:05.010856 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f14ff1de-5792-4af5-a4fd-b89bc24478fe tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:05.011339 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f14ff1de-5792-4af5-a4fd-b89bc24478fe tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:05.011795 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f14ff1de-5792-4af5-a4fd-b89bc24478fe tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:05.012562 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f14ff1de-5792-4af5-a4fd-b89bc24478fe tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:05.013089 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f14ff1de-5792-4af5-a4fd-b89bc24478fe tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:05.013539 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f14ff1de-5792-4af5-a4fd-b89bc24478fe tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:05.049372 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-f14ff1de-5792-4af5-a4fd-b89bc24478fe tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] [instance: 3794302e-1657-4edd-9e15-a78592597d5b] Going to try to terminate instance {{(pid=121232) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 11 11:09:05.412873 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-71e973dc-b449-4518-b35d-418b39436cfe tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-902291155", "imageRef": "05993162-aafd-4f1d-b781-ec09593713e5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4e2afb68-108c-43af-95ea-9643e985c18c"}], "security_groups": [{"name": "tempest-securitygroup--116080356"}], "key_name": "tempest-keypair-1544748498", "user_data": "}} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:09:05.535041 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-f14ff1de-5792-4af5-a4fd-b89bc24478fe tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] 10.222.0.48 "DELETE /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b" status: 204 len: 0 microversion: 2.1 time: 0.542614 Aug 11 11:09:05.536044 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 364/705] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Aug 11 11:09:04 2022] DELETE /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b => generated 0 bytes in 544 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 11 11:09:05.545710 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-10a4a589-3b7f-4e0c-a5db-3dad25ee353b tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:05.546717 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-10a4a589-3b7f-4e0c-a5db-3dad25ee353b tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] [instance: 3794302e-1657-4edd-9e15-a78592597d5b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:05.551076 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.network.neutron [None req-71e973dc-b449-4518-b35d-418b39436cfe tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] validate_networks() for [('4e2afb68-108c-43af-95ea-9643e985c18c', None, None, None, None, None)] {{(pid=121231) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 11 11:09:05.554712 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-10a4a589-3b7f-4e0c-a5db-3dad25ee353b tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:05.555441 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-10a4a589-3b7f-4e0c-a5db-3dad25ee353b tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:05.556137 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-10a4a589-3b7f-4e0c-a5db-3dad25ee353b tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:05.557098 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-10a4a589-3b7f-4e0c-a5db-3dad25ee353b tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:05.558609 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-10a4a589-3b7f-4e0c-a5db-3dad25ee353b tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:05.559258 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-10a4a589-3b7f-4e0c-a5db-3dad25ee353b tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:05.834599 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-10a4a589-3b7f-4e0c-a5db-3dad25ee353b tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfaf5a716c5b448f8e1274de2fad307c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233f1c55781b4099be6e250e664c4fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:05.842853 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-10a4a589-3b7f-4e0c-a5db-3dad25ee353b tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] 10.222.0.48 "GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b" status: 200 len: 1553 microversion: 2.1 time: 0.302356 Aug 11 11:09:05.844040 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 365/706] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:09:05 2022] GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b => generated 1553 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:09:06.164722 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-71e973dc-b449-4518-b35d-418b39436cfe tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Flavor limits 0:0:0 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 11 11:09:06.165147 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-71e973dc-b449-4518-b35d-418b39436cfe tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Image limits 0:0:0 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 11 11:09:06.165617 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-71e973dc-b449-4518-b35d-418b39436cfe tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Flavor pref 0:0:0 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 11 11:09:06.166054 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-71e973dc-b449-4518-b35d-418b39436cfe tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Image pref 0:0:0 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 11 11:09:06.166469 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-71e973dc-b449-4518-b35d-418b39436cfe tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 11 11:09:06.176333 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-71e973dc-b449-4518-b35d-418b39436cfe tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:06.176868 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-71e973dc-b449-4518-b35d-418b39436cfe tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:06.177406 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-71e973dc-b449-4518-b35d-418b39436cfe tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:06.178127 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-71e973dc-b449-4518-b35d-418b39436cfe tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:06.178967 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-71e973dc-b449-4518-b35d-418b39436cfe tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:06.179396 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-71e973dc-b449-4518-b35d-418b39436cfe tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:06.197010 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.quota [None req-71e973dc-b449-4518-b35d-418b39436cfe tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Getting quotas for project b0b3799012d24fad98d155e3b000fc22. Resources: {'ram', 'cores', 'instances'} {{(pid=121231) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 11:09:06.201042 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.quota [None req-71e973dc-b449-4518-b35d-418b39436cfe tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Getting quotas for user bb18a00d44ed4af186bdc589e1e14e22 and project b0b3799012d24fad98d155e3b000fc22. Resources: {'ram', 'cores', 'instances'} {{(pid=121231) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 11:09:06.211994 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-71e973dc-b449-4518-b35d-418b39436cfe tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Going to run 1 instances... {{(pid=121231) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 11 11:09:06.214306 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-71e973dc-b449-4518-b35d-418b39436cfe tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 703afaf7-e5a4-486b-a781-4bd2e3b06981] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='05993162-aafd-4f1d-b781-ec09593713e5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121231) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 11 11:09:06.354557 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-71e973dc-b449-4518-b35d-418b39436cfe tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.946074 Aug 11 11:09:06.355213 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 342/707] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Aug 11 11:09:05 2022] POST /compute/v2.1/servers => generated 401 bytes in 947 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 11 11:09:06.366411 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-1589ad74-d7cf-49e0-bb07-3b3ed74a3902 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:06.367021 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-1589ad74-d7cf-49e0-bb07-3b3ed74a3902 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 703afaf7-e5a4-486b-a781-4bd2e3b06981] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:06.425055 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-1589ad74-d7cf-49e0-bb07-3b3ed74a3902 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:06.432015 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-1589ad74-d7cf-49e0-bb07-3b3ed74a3902 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/703afaf7-e5a4-486b-a781-4bd2e3b06981" status: 200 len: 1237 microversion: 2.1 time: 0.069322 Aug 11 11:09:06.432605 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 366/708] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:09:06 2022] GET /compute/v2.1/servers/703afaf7-e5a4-486b-a781-4bd2e3b06981 => generated 1237 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:09:06.766534 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-04fd841f-9fbe-4261-b413-787be1278a7c tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:06.767028 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-04fd841f-9fbe-4261-b413-787be1278a7c tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: a09cb964-88a4-4fad-ae60-efb0a7a7dec2] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:06.773497 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-04fd841f-9fbe-4261-b413-787be1278a7c tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:06.773990 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-04fd841f-9fbe-4261-b413-787be1278a7c tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:06.774430 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-04fd841f-9fbe-4261-b413-787be1278a7c tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:06.775129 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-04fd841f-9fbe-4261-b413-787be1278a7c tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:06.775584 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-04fd841f-9fbe-4261-b413-787be1278a7c tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:06.776051 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-04fd841f-9fbe-4261-b413-787be1278a7c tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:06.805742 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-04fd841f-9fbe-4261-b413-787be1278a7c tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: a09cb964-88a4-4fad-ae60-efb0a7a7dec2] Going to try to terminate instance {{(pid=121231) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 11 11:09:06.864901 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-56199aad-aa25-41e0-9983-72391004bc89 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:06.865524 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-56199aad-aa25-41e0-9983-72391004bc89 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] [instance: 3794302e-1657-4edd-9e15-a78592597d5b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:06.872338 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-56199aad-aa25-41e0-9983-72391004bc89 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:06.872816 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-56199aad-aa25-41e0-9983-72391004bc89 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:06.873247 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-56199aad-aa25-41e0-9983-72391004bc89 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:06.873926 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-56199aad-aa25-41e0-9983-72391004bc89 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:06.874369 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-56199aad-aa25-41e0-9983-72391004bc89 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:06.874784 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-56199aad-aa25-41e0-9983-72391004bc89 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:07.026290 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-56199aad-aa25-41e0-9983-72391004bc89 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfaf5a716c5b448f8e1274de2fad307c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233f1c55781b4099be6e250e664c4fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:07.035415 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-56199aad-aa25-41e0-9983-72391004bc89 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] 10.222.0.48 "GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b" status: 200 len: 1553 microversion: 2.1 time: 0.174377 Aug 11 11:09:07.036051 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 367/709] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:09:06 2022] GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b => generated 1553 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:09:07.203723 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-04fd841f-9fbe-4261-b413-787be1278a7c tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2" status: 204 len: 0 microversion: 2.1 time: 0.440831 Aug 11 11:09:07.207870 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 343/710] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Aug 11 11:09:06 2022] DELETE /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 11 11:09:07.215074 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-5a31d749-c868-4e61-a43e-712c226f5f71 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:07.215882 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-5a31d749-c868-4e61-a43e-712c226f5f71 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: a09cb964-88a4-4fad-ae60-efb0a7a7dec2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:07.222359 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5a31d749-c868-4e61-a43e-712c226f5f71 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:07.223187 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5a31d749-c868-4e61-a43e-712c226f5f71 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:07.223630 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5a31d749-c868-4e61-a43e-712c226f5f71 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:07.224621 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5a31d749-c868-4e61-a43e-712c226f5f71 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:07.225076 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5a31d749-c868-4e61-a43e-712c226f5f71 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:07.225495 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5a31d749-c868-4e61-a43e-712c226f5f71 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:07.388008 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-5a31d749-c868-4e61-a43e-712c226f5f71 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:07.398037 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-5a31d749-c868-4e61-a43e-712c226f5f71 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2" status: 200 len: 1506 microversion: 2.1 time: 0.188586 Aug 11 11:09:07.398621 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 368/711] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:09:07 2022] GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2 => generated 1506 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:09:07.453064 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-8500a53b-186b-4979-b6e6-57d39d3125e4 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:07.454321 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-8500a53b-186b-4979-b6e6-57d39d3125e4 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 703afaf7-e5a4-486b-a781-4bd2e3b06981] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:07.510108 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-8500a53b-186b-4979-b6e6-57d39d3125e4 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:07.517649 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-8500a53b-186b-4979-b6e6-57d39d3125e4 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/703afaf7-e5a4-486b-a781-4bd2e3b06981" status: 200 len: 1237 microversion: 2.1 time: 0.068768 Aug 11 11:09:07.518218 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 344/712] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:09:07 2022] GET /compute/v2.1/servers/703afaf7-e5a4-486b-a781-4bd2e3b06981 => generated 1237 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:09:08.057132 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-efe00223-b703-4c4f-afd5-be23494a762d tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:08.057852 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-efe00223-b703-4c4f-afd5-be23494a762d tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] [instance: 3794302e-1657-4edd-9e15-a78592597d5b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:08.064397 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-efe00223-b703-4c4f-afd5-be23494a762d tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:08.064879 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-efe00223-b703-4c4f-afd5-be23494a762d tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:08.065305 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-efe00223-b703-4c4f-afd5-be23494a762d tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:08.066139 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-efe00223-b703-4c4f-afd5-be23494a762d tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:08.066603 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-efe00223-b703-4c4f-afd5-be23494a762d tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:08.067028 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-efe00223-b703-4c4f-afd5-be23494a762d tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:08.196291 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-efe00223-b703-4c4f-afd5-be23494a762d tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfaf5a716c5b448f8e1274de2fad307c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233f1c55781b4099be6e250e664c4fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:08.203795 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-efe00223-b703-4c4f-afd5-be23494a762d tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] 10.222.0.48 "GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b" status: 200 len: 1553 microversion: 2.1 time: 0.150597 Aug 11 11:09:08.204351 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 369/713] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:09:08 2022] GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b => generated 1553 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:09:08.418570 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-c95269f6-a390-4611-8854-a816a5b7b356 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:08.419196 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-c95269f6-a390-4611-8854-a816a5b7b356 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: a09cb964-88a4-4fad-ae60-efb0a7a7dec2] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:08.426680 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c95269f6-a390-4611-8854-a816a5b7b356 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:08.427157 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c95269f6-a390-4611-8854-a816a5b7b356 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:08.427602 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c95269f6-a390-4611-8854-a816a5b7b356 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:08.428326 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c95269f6-a390-4611-8854-a816a5b7b356 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:08.428779 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c95269f6-a390-4611-8854-a816a5b7b356 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:08.429204 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c95269f6-a390-4611-8854-a816a5b7b356 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:08.538495 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-5bce5988-5c4a-4f9e-86f5-4184c8ab8415 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:08.539096 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-5bce5988-5c4a-4f9e-86f5-4184c8ab8415 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 703afaf7-e5a4-486b-a781-4bd2e3b06981] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:08.545820 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5bce5988-5c4a-4f9e-86f5-4184c8ab8415 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:08.546314 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5bce5988-5c4a-4f9e-86f5-4184c8ab8415 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:08.546772 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5bce5988-5c4a-4f9e-86f5-4184c8ab8415 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:08.547475 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5bce5988-5c4a-4f9e-86f5-4184c8ab8415 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:08.547962 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5bce5988-5c4a-4f9e-86f5-4184c8ab8415 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:08.548382 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5bce5988-5c4a-4f9e-86f5-4184c8ab8415 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:08.559382 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-c95269f6-a390-4611-8854-a816a5b7b356 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:08.567430 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-c95269f6-a390-4611-8854-a816a5b7b356 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2" status: 200 len: 1506 microversion: 2.1 time: 0.152719 Aug 11 11:09:08.568030 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 345/714] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:09:08 2022] GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2 => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:09:08.618628 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-5bce5988-5c4a-4f9e-86f5-4184c8ab8415 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:08.626248 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-5bce5988-5c4a-4f9e-86f5-4184c8ab8415 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/703afaf7-e5a4-486b-a781-4bd2e3b06981" status: 200 len: 1241 microversion: 2.1 time: 0.091609 Aug 11 11:09:08.626811 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 370/715] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:09:08 2022] GET /compute/v2.1/servers/703afaf7-e5a4-486b-a781-4bd2e3b06981 => generated 1241 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:09:09.225351 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-8ffd516c-e31f-4a7d-8730-a32d87082768 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:09.225993 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-8ffd516c-e31f-4a7d-8730-a32d87082768 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] [instance: 3794302e-1657-4edd-9e15-a78592597d5b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:09.232080 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8ffd516c-e31f-4a7d-8730-a32d87082768 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:09.232559 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8ffd516c-e31f-4a7d-8730-a32d87082768 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:09.232989 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8ffd516c-e31f-4a7d-8730-a32d87082768 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:09.233687 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8ffd516c-e31f-4a7d-8730-a32d87082768 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:09.234127 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8ffd516c-e31f-4a7d-8730-a32d87082768 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:09.235081 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8ffd516c-e31f-4a7d-8730-a32d87082768 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:09.380899 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-8ffd516c-e31f-4a7d-8730-a32d87082768 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfaf5a716c5b448f8e1274de2fad307c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233f1c55781b4099be6e250e664c4fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:09.388638 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-8ffd516c-e31f-4a7d-8730-a32d87082768 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] 10.222.0.48 "GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b" status: 200 len: 1553 microversion: 2.1 time: 0.167117 Aug 11 11:09:09.389200 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 346/716] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:09:09 2022] GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b => generated 1553 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:09:09.588710 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-589df40b-dcee-44b1-9b98-d1bcf37709e4 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:09.589332 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-589df40b-dcee-44b1-9b98-d1bcf37709e4 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: a09cb964-88a4-4fad-ae60-efb0a7a7dec2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:09.596474 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-589df40b-dcee-44b1-9b98-d1bcf37709e4 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:09.596959 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-589df40b-dcee-44b1-9b98-d1bcf37709e4 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:09.597397 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-589df40b-dcee-44b1-9b98-d1bcf37709e4 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:09.598095 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-589df40b-dcee-44b1-9b98-d1bcf37709e4 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:09.598551 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-589df40b-dcee-44b1-9b98-d1bcf37709e4 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:09.598980 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-589df40b-dcee-44b1-9b98-d1bcf37709e4 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:09.618363 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:09:09.647156 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-3d736d65-6fef-44ef-acba-9c1d7835de98 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:09.647902 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-3d736d65-6fef-44ef-acba-9c1d7835de98 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 703afaf7-e5a4-486b-a781-4bd2e3b06981] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:09.654832 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3d736d65-6fef-44ef-acba-9c1d7835de98 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:09.655303 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3d736d65-6fef-44ef-acba-9c1d7835de98 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:09.655730 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3d736d65-6fef-44ef-acba-9c1d7835de98 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:09.656992 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3d736d65-6fef-44ef-acba-9c1d7835de98 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:09.657436 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3d736d65-6fef-44ef-acba-9c1d7835de98 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:09.657851 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3d736d65-6fef-44ef-acba-9c1d7835de98 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:09.742583 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-3d736d65-6fef-44ef-acba-9c1d7835de98 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:09.750262 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-3d736d65-6fef-44ef-acba-9c1d7835de98 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/703afaf7-e5a4-486b-a781-4bd2e3b06981" status: 200 len: 1241 microversion: 2.1 time: 0.107501 Aug 11 11:09:09.756809 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 347/717] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:09:09 2022] GET /compute/v2.1/servers/703afaf7-e5a4-486b-a781-4bd2e3b06981 => generated 1241 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:09:09.766535 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-589df40b-dcee-44b1-9b98-d1bcf37709e4 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:09.774421 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-589df40b-dcee-44b1-9b98-d1bcf37709e4 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2" status: 200 len: 1506 microversion: 2.1 time: 0.189732 Aug 11 11:09:09.775679 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 371/718] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:09:09 2022] GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2 => generated 1506 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:09:10.410838 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-f35c4efc-2f50-4e6f-85de-0e44496e3c29 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:10.411359 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-f35c4efc-2f50-4e6f-85de-0e44496e3c29 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] [instance: 3794302e-1657-4edd-9e15-a78592597d5b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:10.418653 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f35c4efc-2f50-4e6f-85de-0e44496e3c29 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:10.419988 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f35c4efc-2f50-4e6f-85de-0e44496e3c29 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:10.420602 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f35c4efc-2f50-4e6f-85de-0e44496e3c29 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:10.421470 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f35c4efc-2f50-4e6f-85de-0e44496e3c29 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:10.422020 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f35c4efc-2f50-4e6f-85de-0e44496e3c29 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:10.422581 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f35c4efc-2f50-4e6f-85de-0e44496e3c29 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:10.569136 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-f35c4efc-2f50-4e6f-85de-0e44496e3c29 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfaf5a716c5b448f8e1274de2fad307c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233f1c55781b4099be6e250e664c4fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:10.576916 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-f35c4efc-2f50-4e6f-85de-0e44496e3c29 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] 10.222.0.48 "GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b" status: 200 len: 1553 microversion: 2.1 time: 0.170102 Aug 11 11:09:10.577487 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 348/719] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:09:10 2022] GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b => generated 1553 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:09:10.771811 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-3cca67ea-3078-406b-9178-a6da945d034c tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:10.772707 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-3cca67ea-3078-406b-9178-a6da945d034c tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 703afaf7-e5a4-486b-a781-4bd2e3b06981] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:10.780373 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3cca67ea-3078-406b-9178-a6da945d034c tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:10.780859 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3cca67ea-3078-406b-9178-a6da945d034c tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:10.781292 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3cca67ea-3078-406b-9178-a6da945d034c tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:10.781988 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3cca67ea-3078-406b-9178-a6da945d034c tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:10.782437 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3cca67ea-3078-406b-9178-a6da945d034c tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:10.782855 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3cca67ea-3078-406b-9178-a6da945d034c tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:10.798153 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-9d05e6a2-d617-4f1e-b649-e8939578342d tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:10.798782 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-9d05e6a2-d617-4f1e-b649-e8939578342d tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: a09cb964-88a4-4fad-ae60-efb0a7a7dec2] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:10.805643 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9d05e6a2-d617-4f1e-b649-e8939578342d tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:10.806180 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9d05e6a2-d617-4f1e-b649-e8939578342d tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:10.806620 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9d05e6a2-d617-4f1e-b649-e8939578342d tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:10.807328 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9d05e6a2-d617-4f1e-b649-e8939578342d tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:10.807813 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9d05e6a2-d617-4f1e-b649-e8939578342d tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:10.808241 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9d05e6a2-d617-4f1e-b649-e8939578342d tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:10.870760 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-3cca67ea-3078-406b-9178-a6da945d034c tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:10.879751 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-3cca67ea-3078-406b-9178-a6da945d034c tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/703afaf7-e5a4-486b-a781-4bd2e3b06981" status: 200 len: 1289 microversion: 2.1 time: 0.112822 Aug 11 11:09:10.880612 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 372/720] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:09:10 2022] GET /compute/v2.1/servers/703afaf7-e5a4-486b-a781-4bd2e3b06981 => generated 1289 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:09:10.970824 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-9d05e6a2-d617-4f1e-b649-e8939578342d tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:10.979208 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-9d05e6a2-d617-4f1e-b649-e8939578342d tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2" status: 200 len: 1506 microversion: 2.1 time: 0.185666 Aug 11 11:09:10.979966 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 349/721] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:09:10 2022] GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2 => generated 1506 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:09:11.600150 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-e0b248bd-2bf4-4541-9b40-9ffaf539a3d3 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:11.601094 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-e0b248bd-2bf4-4541-9b40-9ffaf539a3d3 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] [instance: 3794302e-1657-4edd-9e15-a78592597d5b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:11.610368 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e0b248bd-2bf4-4541-9b40-9ffaf539a3d3 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:11.610862 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e0b248bd-2bf4-4541-9b40-9ffaf539a3d3 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:11.611294 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e0b248bd-2bf4-4541-9b40-9ffaf539a3d3 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:11.612033 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e0b248bd-2bf4-4541-9b40-9ffaf539a3d3 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:11.612490 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e0b248bd-2bf4-4541-9b40-9ffaf539a3d3 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:11.618944 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e0b248bd-2bf4-4541-9b40-9ffaf539a3d3 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:11.661523 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-82c44f8c-7cc8-4aad-ad9e-c1397eb8c45f req-c78138e7-1ca3-4fce-bcc2-12bea1f195db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a09cb964-88a4-4fad-ae60-efb0a7a7dec2", "name": "network-vif-deleted", "tag": "1fe4417c-0d11-448d-803e-4fef1c525582"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:09:11.683058 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-82c44f8c-7cc8-4aad-ad9e-c1397eb8c45f req-c78138e7-1ca3-4fce-bcc2-12bea1f195db service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:11.692166 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-82c44f8c-7cc8-4aad-ad9e-c1397eb8c45f req-c78138e7-1ca3-4fce-bcc2-12bea1f195db service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:11.692614 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-82c44f8c-7cc8-4aad-ad9e-c1397eb8c45f req-c78138e7-1ca3-4fce-bcc2-12bea1f195db service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:11.706145 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-82c44f8c-7cc8-4aad-ad9e-c1397eb8c45f req-c78138e7-1ca3-4fce-bcc2-12bea1f195db service nova] Creating event network-vif-deleted:1fe4417c-0d11-448d-803e-4fef1c525582 for instance a09cb964-88a4-4fad-ae60-efb0a7a7dec2 on hv-cinder-82002 Aug 11 11:09:11.711385 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-82c44f8c-7cc8-4aad-ad9e-c1397eb8c45f req-c78138e7-1ca3-4fce-bcc2-12bea1f195db service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.205493 Aug 11 11:09:11.712021 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 373/722] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:09:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:09:11.736370 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-e0b248bd-2bf4-4541-9b40-9ffaf539a3d3 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfaf5a716c5b448f8e1274de2fad307c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233f1c55781b4099be6e250e664c4fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:11.744127 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-e0b248bd-2bf4-4541-9b40-9ffaf539a3d3 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] 10.222.0.48 "GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b" status: 200 len: 1511 microversion: 2.1 time: 0.148937 Aug 11 11:09:11.744712 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 350/723] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:09:11 2022] GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b => generated 1511 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:09:11.900747 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-507168cb-9289-4091-8a18-163789287160 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:11.904337 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-507168cb-9289-4091-8a18-163789287160 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 703afaf7-e5a4-486b-a781-4bd2e3b06981] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:11.911463 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-507168cb-9289-4091-8a18-163789287160 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:11.916816 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-507168cb-9289-4091-8a18-163789287160 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:11.917633 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-507168cb-9289-4091-8a18-163789287160 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:11.918470 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-507168cb-9289-4091-8a18-163789287160 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:11.919085 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-507168cb-9289-4091-8a18-163789287160 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:11.920036 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-507168cb-9289-4091-8a18-163789287160 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:12.002991 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-f00fb819-833a-49a7-9978-c0e5e24067e5 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:12.004219 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-f00fb819-833a-49a7-9978-c0e5e24067e5 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: a09cb964-88a4-4fad-ae60-efb0a7a7dec2] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:12.005334 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-507168cb-9289-4091-8a18-163789287160 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:12.012996 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f00fb819-833a-49a7-9978-c0e5e24067e5 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:12.014138 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f00fb819-833a-49a7-9978-c0e5e24067e5 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:12.014928 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f00fb819-833a-49a7-9978-c0e5e24067e5 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:12.016615 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f00fb819-833a-49a7-9978-c0e5e24067e5 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:12.017106 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-507168cb-9289-4091-8a18-163789287160 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/703afaf7-e5a4-486b-a781-4bd2e3b06981" status: 200 len: 1295 microversion: 2.1 time: 0.120531 Aug 11 11:09:12.018078 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f00fb819-833a-49a7-9978-c0e5e24067e5 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:12.018888 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f00fb819-833a-49a7-9978-c0e5e24067e5 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:12.037087 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 374/724] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:09:11 2022] GET /compute/v2.1/servers/703afaf7-e5a4-486b-a781-4bd2e3b06981 => generated 1295 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:09:12.071827 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f00fb819-833a-49a7-9978-c0e5e24067e5 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:12.072659 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f00fb819-833a-49a7-9978-c0e5e24067e5 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:12.073466 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f00fb819-833a-49a7-9978-c0e5e24067e5 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:12.074462 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.objects.instance [None req-f00fb819-833a-49a7-9978-c0e5e24067e5 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lazy-loading 'fault' on Instance uuid a09cb964-88a4-4fad-ae60-efb0a7a7dec2 {{(pid=121231) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 11:09:12.081254 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:09:12.146309 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-f00fb819-833a-49a7-9978-c0e5e24067e5 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:12.158241 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-f00fb819-833a-49a7-9978-c0e5e24067e5 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2" status: 200 len: 1311 microversion: 2.1 time: 0.161057 Aug 11 11:09:12.171885 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 351/725] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:09:11 2022] GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2 => generated 1311 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:09:12.766163 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-b3b7c87a-4ef3-45ab-98a6-1efaca930c25 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:12.766739 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-b3b7c87a-4ef3-45ab-98a6-1efaca930c25 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] [instance: 3794302e-1657-4edd-9e15-a78592597d5b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:12.772731 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b3b7c87a-4ef3-45ab-98a6-1efaca930c25 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:12.773223 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b3b7c87a-4ef3-45ab-98a6-1efaca930c25 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:12.773660 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b3b7c87a-4ef3-45ab-98a6-1efaca930c25 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:12.774368 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b3b7c87a-4ef3-45ab-98a6-1efaca930c25 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:12.774825 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b3b7c87a-4ef3-45ab-98a6-1efaca930c25 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:12.775249 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b3b7c87a-4ef3-45ab-98a6-1efaca930c25 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:12.809370 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b3b7c87a-4ef3-45ab-98a6-1efaca930c25 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:12.809854 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b3b7c87a-4ef3-45ab-98a6-1efaca930c25 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:12.810319 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b3b7c87a-4ef3-45ab-98a6-1efaca930c25 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:12.810805 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.objects.instance [None req-b3b7c87a-4ef3-45ab-98a6-1efaca930c25 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lazy-loading 'fault' on Instance uuid 3794302e-1657-4edd-9e15-a78592597d5b {{(pid=121232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 11:09:12.862937 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-b3b7c87a-4ef3-45ab-98a6-1efaca930c25 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfaf5a716c5b448f8e1274de2fad307c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '233f1c55781b4099be6e250e664c4fb9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:12.876707 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-b3b7c87a-4ef3-45ab-98a6-1efaca930c25 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] 10.222.0.48 "GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b" status: 200 len: 1348 microversion: 2.1 time: 0.114224 Aug 11 11:09:12.877309 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 375/726] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:09:12 2022] GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b => generated 1348 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:09:13.045143 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-307e29a7-4959-4455-8ce3-03b6bc47821d tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:13.046256 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-307e29a7-4959-4455-8ce3-03b6bc47821d tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 703afaf7-e5a4-486b-a781-4bd2e3b06981] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:13.058032 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-307e29a7-4959-4455-8ce3-03b6bc47821d tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:13.058732 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-307e29a7-4959-4455-8ce3-03b6bc47821d tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:13.059180 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-307e29a7-4959-4455-8ce3-03b6bc47821d tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:13.059922 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-307e29a7-4959-4455-8ce3-03b6bc47821d tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:13.060389 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-307e29a7-4959-4455-8ce3-03b6bc47821d tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:13.060813 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-307e29a7-4959-4455-8ce3-03b6bc47821d tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:13.180397 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-ad6cb1e7-3890-442b-9375-e89211cbb1d0 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:13.180996 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-ad6cb1e7-3890-442b-9375-e89211cbb1d0 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: a09cb964-88a4-4fad-ae60-efb0a7a7dec2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:13.188825 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ad6cb1e7-3890-442b-9375-e89211cbb1d0 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:13.189323 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ad6cb1e7-3890-442b-9375-e89211cbb1d0 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:13.189762 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ad6cb1e7-3890-442b-9375-e89211cbb1d0 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:13.190479 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ad6cb1e7-3890-442b-9375-e89211cbb1d0 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:13.190928 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ad6cb1e7-3890-442b-9375-e89211cbb1d0 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:13.191356 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ad6cb1e7-3890-442b-9375-e89211cbb1d0 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:13.239532 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ad6cb1e7-3890-442b-9375-e89211cbb1d0 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:13.240169 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ad6cb1e7-3890-442b-9375-e89211cbb1d0 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:13.240734 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ad6cb1e7-3890-442b-9375-e89211cbb1d0 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:13.241302 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.objects.instance [None req-ad6cb1e7-3890-442b-9375-e89211cbb1d0 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lazy-loading 'fault' on Instance uuid a09cb964-88a4-4fad-ae60-efb0a7a7dec2 {{(pid=121232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 11:09:13.449927 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-ad6cb1e7-3890-442b-9375-e89211cbb1d0 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:13.459954 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-ad6cb1e7-3890-442b-9375-e89211cbb1d0 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2" status: 200 len: 1311 microversion: 2.1 time: 0.283371 Aug 11 11:09:13.460563 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 376/727] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:09:13 2022] GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2 => generated 1311 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:09:13.552334 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-307e29a7-4959-4455-8ce3-03b6bc47821d tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:13.560244 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-307e29a7-4959-4455-8ce3-03b6bc47821d tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/703afaf7-e5a4-486b-a781-4bd2e3b06981" status: 200 len: 1362 microversion: 2.1 time: 0.519377 Aug 11 11:09:13.567393 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 352/728] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:09:13 2022] GET /compute/v2.1/servers/703afaf7-e5a4-486b-a781-4bd2e3b06981 => generated 1362 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:09:13.726280 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-783fc464-bbce-4baf-8fae-d13d23d7acbd req-08e38554-3e7b-4ce9-9b2c-d8a624fe9cde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3794302e-1657-4edd-9e15-a78592597d5b", "name": "network-vif-deleted", "tag": "8d6a01cf-8904-414f-b58d-2be53d6e73d1"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:09:13.736881 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-783fc464-bbce-4baf-8fae-d13d23d7acbd req-08e38554-3e7b-4ce9-9b2c-d8a624fe9cde service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:13.737347 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-783fc464-bbce-4baf-8fae-d13d23d7acbd req-08e38554-3e7b-4ce9-9b2c-d8a624fe9cde service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:13.737771 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-783fc464-bbce-4baf-8fae-d13d23d7acbd req-08e38554-3e7b-4ce9-9b2c-d8a624fe9cde service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:13.748329 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-783fc464-bbce-4baf-8fae-d13d23d7acbd req-08e38554-3e7b-4ce9-9b2c-d8a624fe9cde service nova] Creating event network-vif-deleted:8d6a01cf-8904-414f-b58d-2be53d6e73d1 for instance 3794302e-1657-4edd-9e15-a78592597d5b on hv-cinder-82002 Aug 11 11:09:13.753111 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-783fc464-bbce-4baf-8fae-d13d23d7acbd req-08e38554-3e7b-4ce9-9b2c-d8a624fe9cde service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030637 Aug 11 11:09:13.753769 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 377/729] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:09:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:09:13.899136 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-04f4f060-fd85-4f60-b6fd-8dc8bc0f3d49 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:13.899821 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-04f4f060-fd85-4f60-b6fd-8dc8bc0f3d49 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] [instance: 3794302e-1657-4edd-9e15-a78592597d5b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:13.906876 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-04f4f060-fd85-4f60-b6fd-8dc8bc0f3d49 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:13.911246 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-04f4f060-fd85-4f60-b6fd-8dc8bc0f3d49 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:13.911246 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-04f4f060-fd85-4f60-b6fd-8dc8bc0f3d49 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:13.911246 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-04f4f060-fd85-4f60-b6fd-8dc8bc0f3d49 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:13.911246 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-04f4f060-fd85-4f60-b6fd-8dc8bc0f3d49 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:13.911621 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-04f4f060-fd85-4f60-b6fd-8dc8bc0f3d49 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:13.924524 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.wsgi [None req-04f4f060-fd85-4f60-b6fd-8dc8bc0f3d49 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] HTTP exception thrown: Instance 3794302e-1657-4edd-9e15-a78592597d5b could not be found. Aug 11 11:09:13.926299 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-04f4f060-fd85-4f60-b6fd-8dc8bc0f3d49 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Request method failure captured: Aug 11 11:09:13.926299 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: request: GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b HTTP/1.1 Aug 11 11:09:13.926299 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Accept: application/json Aug 11 11:09:13.926299 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Accept-Encoding: identity Aug 11 11:09:13.926299 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Connection: close Aug 11 11:09:13.926299 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Content-Length: 0 Aug 11 11:09:13.926299 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Content-Type: application/json Aug 11 11:09:13.926299 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Host: 10.222.0.48 Aug 11 11:09:13.926299 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Openstack-System-Scope: None Aug 11 11:09:13.926299 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: User-Agent: python-urllib3/1.26.11 Aug 11 11:09:13.926299 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Auth-Token: gAAAAABi9OKJibBCBi9GM_Z3oi8N6AFQphml8gJGwThjsB2NMCQsd1e1jvAEEpOWAoX5DY_2downfis7q5l_wfJLZbX_ppSjVcgqsG8xnqlluqz3UEpZ7UAZXtbhD2LB_FrwtkJ49E2IsERolf7vcHD8ItDAkoK2vH1pSn_i8zgKKWtc1m6ASNU Aug 11 11:09:13.926299 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Domain-Id: None Aug 11 11:09:13.926299 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Domain-Name: None Aug 11 11:09:13.926299 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Identity-Status: Confirmed Aug 11 11:09:13.926299 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Is-Admin-Project: True Aug 11 11:09:13.926299 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Domain-Id: default Aug 11 11:09:13.926299 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Domain-Name: Default Aug 11 11:09:13.926299 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Id: 233f1c55781b4099be6e250e664c4fb9 Aug 11 11:09:13.926299 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Name: tempest-TestMinimumBasicScenario-1792480745 Aug 11 11:09:13.926299 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Role: reader,member Aug 11 11:09:13.926299 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Roles: reader,member Aug 11 11:09:13.927798 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/233f1c55781b4099be6e250e664c4fb9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/233f1c55781b4099be6e250e664c4fb9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/233f1c55781b4099be6e250e664c4fb9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_233f1c55781b4099be6e250e664c4fb9", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] Aug 11 11:09:13.927798 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant: tempest-TestMinimumBasicScenario-1792480745 Aug 11 11:09:13.927798 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant-Id: 233f1c55781b4099be6e250e664c4fb9 Aug 11 11:09:13.927798 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1792480745 Aug 11 11:09:13.927798 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User: tempest-TestMinimumBasicScenario-1792480745-project Aug 11 11:09:13.927798 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Domain-Id: default Aug 11 11:09:13.927798 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Domain-Name: Default Aug 11 11:09:13.927798 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Id: dfaf5a716c5b448f8e1274de2fad307c Aug 11 11:09:13.927798 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Name: tempest-TestMinimumBasicScenario-1792480745-project Aug 11 11:09:13.927798 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: method: > Aug 11 11:09:13.927798 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: exception: Instance 3794302e-1657-4edd-9e15-a78592597d5b could not be found. Aug 11 11:09:13.927798 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: action_args: {'id': '3794302e-1657-4edd-9e15-a78592597d5b'} Aug 11 11:09:13.928988 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 11:09:13.928988 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:09:13.928988 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 11:09:13.928988 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 11:09:13.928988 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 11:09:13.928988 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 11:09:13.928988 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 11:09:13.928988 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 11:09:13.928988 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 11:09:13.928988 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 11:09:13.928988 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3794302e-1657-4edd-9e15-a78592597d5b could not be found. Aug 11 11:09:13.928988 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:09:13.928988 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:09:13.928988 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:09:13.928988 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:09:13.928988 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:09:13.928988 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:09:13.928988 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 11:09:13.928988 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 11:09:13.928988 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 11:09:13.930544 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 11:09:13.930544 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 11:09:13.930544 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 11:09:13.930544 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 11:09:13.930544 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 11:09:13.930544 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 11:09:13.930544 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 11:09:13.930544 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3794302e-1657-4edd-9e15-a78592597d5b could not be found. Aug 11 11:09:13.930544 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:09:13.930544 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:09:13.930544 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:09:13.930544 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:09:13.930544 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:09:13.930544 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:09:13.930544 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 11:09:13.930544 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 11:09:13.930544 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3794302e-1657-4edd-9e15-a78592597d5b could not be found. Aug 11 11:09:13.930544 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:09:13.932025 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-04f4f060-fd85-4f60-b6fd-8dc8bc0f3d49 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Returning 404 to user: Instance 3794302e-1657-4edd-9e15-a78592597d5b could not be found. {{(pid=121231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 11:09:13.932025 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-04f4f060-fd85-4f60-b6fd-8dc8bc0f3d49 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] 10.222.0.48 "GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b" status: 404 len: 111 microversion: 2.1 time: 0.033085 Aug 11 11:09:13.932025 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 353/730] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:09:13 2022] GET /compute/v2.1/servers/3794302e-1657-4edd-9e15-a78592597d5b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 11:09:13.938100 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-8d244576-b4fd-4c8d-b241-bd95db3e7a23 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] Calling method '.version_select at 0x7faab0d51ee0>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:14.074403 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-8d244576-b4fd-4c8d-b241-bd95db3e7a23 tempest-TestMinimumBasicScenario-1792480745 tempest-TestMinimumBasicScenario-1792480745-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-869976892" status: 202 len: 0 microversion: 2.1 time: 0.140436 Aug 11 11:09:14.075116 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 378/731] 10.222.0.48 () {58 vars in 1269 bytes} [Thu Aug 11 11:09:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-869976892 => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 11:09:14.138485 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-a6cdbec8-8d0a-454c-8071-6efa09d175ed req-7b14a4a9-a18e-4990-89d2-7697437f0121 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "703afaf7-e5a4-486b-a781-4bd2e3b06981", "tag": "03264dbf-1d91-494b-b399-8a502d9530a4"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:09:14.149918 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-a6cdbec8-8d0a-454c-8071-6efa09d175ed req-7b14a4a9-a18e-4990-89d2-7697437f0121 service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:14.150394 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-a6cdbec8-8d0a-454c-8071-6efa09d175ed req-7b14a4a9-a18e-4990-89d2-7697437f0121 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:14.150821 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-a6cdbec8-8d0a-454c-8071-6efa09d175ed req-7b14a4a9-a18e-4990-89d2-7697437f0121 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:14.163970 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-a6cdbec8-8d0a-454c-8071-6efa09d175ed req-7b14a4a9-a18e-4990-89d2-7697437f0121 service nova] Creating event network-changed:03264dbf-1d91-494b-b399-8a502d9530a4 for instance 703afaf7-e5a4-486b-a781-4bd2e3b06981 on hv-cinder-82002 Aug 11 11:09:14.168719 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-a6cdbec8-8d0a-454c-8071-6efa09d175ed req-7b14a4a9-a18e-4990-89d2-7697437f0121 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105356 Aug 11 11:09:14.169641 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 354/732] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:09:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 11:09:14.481605 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-cf731f6d-b499-4d39-b11c-9eef7db4482b tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:14.482345 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-cf731f6d-b499-4d39-b11c-9eef7db4482b tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: a09cb964-88a4-4fad-ae60-efb0a7a7dec2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:14.489829 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cf731f6d-b499-4d39-b11c-9eef7db4482b tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:14.490328 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cf731f6d-b499-4d39-b11c-9eef7db4482b tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:14.490776 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cf731f6d-b499-4d39-b11c-9eef7db4482b tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:14.491466 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cf731f6d-b499-4d39-b11c-9eef7db4482b tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:14.491968 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cf731f6d-b499-4d39-b11c-9eef7db4482b tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:14.492456 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cf731f6d-b499-4d39-b11c-9eef7db4482b tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:14.506823 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.wsgi [None req-cf731f6d-b499-4d39-b11c-9eef7db4482b tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] HTTP exception thrown: Instance a09cb964-88a4-4fad-ae60-efb0a7a7dec2 could not be found. Aug 11 11:09:14.508616 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-cf731f6d-b499-4d39-b11c-9eef7db4482b tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Request method failure captured: Aug 11 11:09:14.508616 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: request: GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2 HTTP/1.1 Aug 11 11:09:14.508616 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Accept: application/json Aug 11 11:09:14.508616 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Accept-Encoding: identity Aug 11 11:09:14.508616 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Connection: close Aug 11 11:09:14.508616 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Content-Length: 0 Aug 11 11:09:14.508616 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Content-Type: application/json Aug 11 11:09:14.508616 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Host: 10.222.0.48 Aug 11 11:09:14.508616 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Openstack-System-Scope: None Aug 11 11:09:14.508616 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: User-Agent: python-urllib3/1.26.11 Aug 11 11:09:14.508616 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Auth-Token: gAAAAABi9OIZrQLD9wcn33oOAILRLRgizejVjH27hxki3e7YaqpWc9w5AB6twcQbo6ujH2ticAWA98YJt2oEA_0zpX3GqgJkSqqHfHltxhU9T4SgJ_YQxUiy9cMGURf0wSoT5Vg71mc-C9U7FKhPy_DOheOZskafHmoddANNVZO-sZBS_1qYvI4 Aug 11 11:09:14.508616 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Domain-Id: None Aug 11 11:09:14.508616 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Domain-Name: None Aug 11 11:09:14.508616 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Identity-Status: Confirmed Aug 11 11:09:14.508616 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Is-Admin-Project: True Aug 11 11:09:14.508616 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Domain-Id: default Aug 11 11:09:14.508616 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Domain-Name: Default Aug 11 11:09:14.508616 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Id: e8751d4bd74240db9b57b7e9f788df94 Aug 11 11:09:14.508616 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1157402601 Aug 11 11:09:14.508616 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Role: reader,member Aug 11 11:09:14.508616 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Roles: reader,member Aug 11 11:09:14.510500 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e8751d4bd74240db9b57b7e9f788df94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e8751d4bd74240db9b57b7e9f788df94"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e8751d4bd74240db9b57b7e9f788df94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e8751d4bd74240db9b57b7e9f788df94", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] Aug 11 11:09:14.510500 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1157402601 Aug 11 11:09:14.510500 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Tenant-Id: e8751d4bd74240db9b57b7e9f788df94 Aug 11 11:09:14.510500 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1157402601 Aug 11 11:09:14.510500 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User: tempest-ServerRescueNegativeTestJSON-1157402601-project Aug 11 11:09:14.510500 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Domain-Id: default Aug 11 11:09:14.510500 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Domain-Name: Default Aug 11 11:09:14.510500 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Id: 684d59041e82466d8aad6d2964842bf5 Aug 11 11:09:14.510500 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1157402601-project Aug 11 11:09:14.510500 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: method: > Aug 11 11:09:14.510500 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: exception: Instance a09cb964-88a4-4fad-ae60-efb0a7a7dec2 could not be found. Aug 11 11:09:14.510500 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: action_args: {'id': 'a09cb964-88a4-4fad-ae60-efb0a7a7dec2'} Aug 11 11:09:14.515135 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 11:09:14.515135 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:09:14.515135 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 11:09:14.515135 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 11:09:14.515135 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 11:09:14.515135 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 11:09:14.515135 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 11:09:14.515135 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 11:09:14.515135 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 11:09:14.515135 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 11:09:14.515135 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a09cb964-88a4-4fad-ae60-efb0a7a7dec2 could not be found. Aug 11 11:09:14.515135 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:09:14.515135 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:09:14.515135 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:09:14.515135 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:09:14.515135 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:09:14.515135 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:09:14.515135 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 11:09:14.515135 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 11:09:14.515135 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 11:09:14.516534 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 11:09:14.516534 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 11:09:14.516534 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 11:09:14.516534 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 11:09:14.516534 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 11:09:14.516534 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 11:09:14.516534 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 11:09:14.516534 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a09cb964-88a4-4fad-ae60-efb0a7a7dec2 could not be found. Aug 11 11:09:14.516534 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:09:14.516534 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:09:14.516534 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:09:14.516534 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:09:14.516534 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:09:14.516534 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:09:14.516534 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 11:09:14.516534 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 11:09:14.516534 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a09cb964-88a4-4fad-ae60-efb0a7a7dec2 could not be found. Aug 11 11:09:14.516534 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:09:14.517834 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-cf731f6d-b499-4d39-b11c-9eef7db4482b tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Returning 404 to user: Instance a09cb964-88a4-4fad-ae60-efb0a7a7dec2 could not be found. {{(pid=121232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 11:09:14.517834 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-cf731f6d-b499-4d39-b11c-9eef7db4482b tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2" status: 404 len: 111 microversion: 2.1 time: 0.032923 Aug 11 11:09:14.517834 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 379/733] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:09:14 2022] GET /compute/v2.1/servers/a09cb964-88a4-4fad-ae60-efb0a7a7dec2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 11:09:14.524650 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-41a23145-2efe-4731-9273-7bd0ff78a147 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:14.525137 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-41a23145-2efe-4731-9273-7bd0ff78a147 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 7cfaa606-ef7e-4594-aaba-72be96386bd7] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:14.531489 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-41a23145-2efe-4731-9273-7bd0ff78a147 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:14.532007 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-41a23145-2efe-4731-9273-7bd0ff78a147 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:14.532598 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-41a23145-2efe-4731-9273-7bd0ff78a147 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:14.533124 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-41a23145-2efe-4731-9273-7bd0ff78a147 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:14.533578 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-41a23145-2efe-4731-9273-7bd0ff78a147 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:14.534004 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-41a23145-2efe-4731-9273-7bd0ff78a147 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:14.561882 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-41a23145-2efe-4731-9273-7bd0ff78a147 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 7cfaa606-ef7e-4594-aaba-72be96386bd7] Going to try to terminate instance {{(pid=121231) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 11 11:09:14.582580 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-583cb582-c927-47f7-a7b2-13b1ff5fa1e6 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:14.583264 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-583cb582-c927-47f7-a7b2-13b1ff5fa1e6 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 703afaf7-e5a4-486b-a781-4bd2e3b06981] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:14.589551 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-583cb582-c927-47f7-a7b2-13b1ff5fa1e6 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:14.590283 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-583cb582-c927-47f7-a7b2-13b1ff5fa1e6 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:14.590897 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-583cb582-c927-47f7-a7b2-13b1ff5fa1e6 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:14.591982 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-583cb582-c927-47f7-a7b2-13b1ff5fa1e6 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:14.592508 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-583cb582-c927-47f7-a7b2-13b1ff5fa1e6 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:14.593123 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-583cb582-c927-47f7-a7b2-13b1ff5fa1e6 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:14.794151 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:09:14.818962 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-583cb582-c927-47f7-a7b2-13b1ff5fa1e6 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:14.827071 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-583cb582-c927-47f7-a7b2-13b1ff5fa1e6 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/703afaf7-e5a4-486b-a781-4bd2e3b06981" status: 200 len: 1362 microversion: 2.1 time: 0.248637 Aug 11 11:09:14.837052 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 380/734] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:09:14 2022] GET /compute/v2.1/servers/703afaf7-e5a4-486b-a781-4bd2e3b06981 => generated 1362 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:09:14.907043 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-41a23145-2efe-4731-9273-7bd0ff78a147 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "DELETE /compute/v2.1/servers/7cfaa606-ef7e-4594-aaba-72be96386bd7" status: 204 len: 0 microversion: 2.1 time: 0.386016 Aug 11 11:09:14.907637 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 355/735] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Aug 11 11:09:14 2022] DELETE /compute/v2.1/servers/7cfaa606-ef7e-4594-aaba-72be96386bd7 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 11 11:09:14.917751 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-2242f6e1-6bec-41a9-9840-7ab2e29ba64b tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:14.918442 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-2242f6e1-6bec-41a9-9840-7ab2e29ba64b tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 7cfaa606-ef7e-4594-aaba-72be96386bd7] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:14.921246 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=2,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:09:14.926016 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2242f6e1-6bec-41a9-9840-7ab2e29ba64b tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:14.932982 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2242f6e1-6bec-41a9-9840-7ab2e29ba64b tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:14.932982 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2242f6e1-6bec-41a9-9840-7ab2e29ba64b tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:14.932982 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2242f6e1-6bec-41a9-9840-7ab2e29ba64b tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:14.932982 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2242f6e1-6bec-41a9-9840-7ab2e29ba64b tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:14.933378 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2242f6e1-6bec-41a9-9840-7ab2e29ba64b tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:15.072424 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-2242f6e1-6bec-41a9-9840-7ab2e29ba64b tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:15.081078 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-2242f6e1-6bec-41a9-9840-7ab2e29ba64b tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/7cfaa606-ef7e-4594-aaba-72be96386bd7" status: 200 len: 1520 microversion: 2.1 time: 0.169380 Aug 11 11:09:15.081646 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 381/736] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:09:14 2022] GET /compute/v2.1/servers/7cfaa606-ef7e-4594-aaba-72be96386bd7 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:09:15.849141 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-09b16af5-ae30-4252-a957-a7c52a0063e2 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:15.850036 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-09b16af5-ae30-4252-a957-a7c52a0063e2 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 703afaf7-e5a4-486b-a781-4bd2e3b06981] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:15.857151 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-09b16af5-ae30-4252-a957-a7c52a0063e2 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:15.857577 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-09b16af5-ae30-4252-a957-a7c52a0063e2 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:15.858012 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-09b16af5-ae30-4252-a957-a7c52a0063e2 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:15.858708 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-09b16af5-ae30-4252-a957-a7c52a0063e2 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:15.859325 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-09b16af5-ae30-4252-a957-a7c52a0063e2 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:15.859799 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-09b16af5-ae30-4252-a957-a7c52a0063e2 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:15.999113 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-09b16af5-ae30-4252-a957-a7c52a0063e2 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:16.007640 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-09b16af5-ae30-4252-a957-a7c52a0063e2 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/703afaf7-e5a4-486b-a781-4bd2e3b06981" status: 200 len: 1362 microversion: 2.1 time: 0.162295 Aug 11 11:09:16.021634 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 356/737] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:09:15 2022] GET /compute/v2.1/servers/703afaf7-e5a4-486b-a781-4bd2e3b06981 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:09:16.101226 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-02b02d31-a0a0-4b31-8de6-e575d6b66af6 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:16.101856 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-02b02d31-a0a0-4b31-8de6-e575d6b66af6 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 7cfaa606-ef7e-4594-aaba-72be96386bd7] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:16.109723 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-02b02d31-a0a0-4b31-8de6-e575d6b66af6 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:16.110297 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-02b02d31-a0a0-4b31-8de6-e575d6b66af6 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:16.110739 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-02b02d31-a0a0-4b31-8de6-e575d6b66af6 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:16.111432 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-02b02d31-a0a0-4b31-8de6-e575d6b66af6 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:16.111926 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-02b02d31-a0a0-4b31-8de6-e575d6b66af6 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:16.112350 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-02b02d31-a0a0-4b31-8de6-e575d6b66af6 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:16.248687 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-02b02d31-a0a0-4b31-8de6-e575d6b66af6 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:16.257053 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-02b02d31-a0a0-4b31-8de6-e575d6b66af6 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/7cfaa606-ef7e-4594-aaba-72be96386bd7" status: 200 len: 1520 microversion: 2.1 time: 0.159885 Aug 11 11:09:16.257699 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 382/738] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:09:16 2022] GET /compute/v2.1/servers/7cfaa606-ef7e-4594-aaba-72be96386bd7 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:09:17.029368 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-11a95824-1f24-4dda-83a1-84fe8e63c4cd tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:17.030095 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-11a95824-1f24-4dda-83a1-84fe8e63c4cd tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 703afaf7-e5a4-486b-a781-4bd2e3b06981] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:17.032620 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell0:SELECT=2 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:09:17.037964 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-11a95824-1f24-4dda-83a1-84fe8e63c4cd tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:17.042088 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-11a95824-1f24-4dda-83a1-84fe8e63c4cd tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:17.042088 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-11a95824-1f24-4dda-83a1-84fe8e63c4cd tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:17.042088 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-11a95824-1f24-4dda-83a1-84fe8e63c4cd tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:17.042088 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-11a95824-1f24-4dda-83a1-84fe8e63c4cd tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:17.042455 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-11a95824-1f24-4dda-83a1-84fe8e63c4cd tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:17.252576 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-11a95824-1f24-4dda-83a1-84fe8e63c4cd tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:17.260487 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-11a95824-1f24-4dda-83a1-84fe8e63c4cd tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/703afaf7-e5a4-486b-a781-4bd2e3b06981" status: 200 len: 1362 microversion: 2.1 time: 0.234925 Aug 11 11:09:17.275320 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 357/739] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:09:17 2022] GET /compute/v2.1/servers/703afaf7-e5a4-486b-a781-4bd2e3b06981 => generated 1362 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:09:17.279491 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-c7ac3db6-9b31-4988-888e-3b67ded655d1 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:17.280136 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-c7ac3db6-9b31-4988-888e-3b67ded655d1 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 7cfaa606-ef7e-4594-aaba-72be96386bd7] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:17.282344 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell0:SELECT=10 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:09:17.288391 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c7ac3db6-9b31-4988-888e-3b67ded655d1 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:17.289014 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c7ac3db6-9b31-4988-888e-3b67ded655d1 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:17.292507 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c7ac3db6-9b31-4988-888e-3b67ded655d1 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:17.292507 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c7ac3db6-9b31-4988-888e-3b67ded655d1 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:17.292507 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c7ac3db6-9b31-4988-888e-3b67ded655d1 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:17.292507 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c7ac3db6-9b31-4988-888e-3b67ded655d1 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:17.491360 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-c7ac3db6-9b31-4988-888e-3b67ded655d1 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:17.502454 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-c7ac3db6-9b31-4988-888e-3b67ded655d1 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/7cfaa606-ef7e-4594-aaba-72be96386bd7" status: 200 len: 1520 microversion: 2.1 time: 0.228386 Aug 11 11:09:17.504027 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 383/740] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:09:17 2022] GET /compute/v2.1/servers/7cfaa606-ef7e-4594-aaba-72be96386bd7 => generated 1520 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:09:18.282618 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-dab829f7-9e3f-476d-8367-489c6e922401 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:18.283266 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-dab829f7-9e3f-476d-8367-489c6e922401 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 703afaf7-e5a4-486b-a781-4bd2e3b06981] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:18.285239 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell0:SELECT=8 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:09:18.290681 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-dab829f7-9e3f-476d-8367-489c6e922401 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:18.291162 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-dab829f7-9e3f-476d-8367-489c6e922401 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:18.291594 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-dab829f7-9e3f-476d-8367-489c6e922401 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:18.292327 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-dab829f7-9e3f-476d-8367-489c6e922401 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:18.292781 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-dab829f7-9e3f-476d-8367-489c6e922401 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:18.293199 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-dab829f7-9e3f-476d-8367-489c6e922401 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:18.524527 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-00848171-ceb6-4288-87fb-587479105c7a tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:18.526183 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-00848171-ceb6-4288-87fb-587479105c7a tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 7cfaa606-ef7e-4594-aaba-72be96386bd7] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:18.533873 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-00848171-ceb6-4288-87fb-587479105c7a tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:18.534374 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-00848171-ceb6-4288-87fb-587479105c7a tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:18.534809 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-00848171-ceb6-4288-87fb-587479105c7a tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:18.535546 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-00848171-ceb6-4288-87fb-587479105c7a tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:18.536205 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-00848171-ceb6-4288-87fb-587479105c7a tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:18.536898 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-00848171-ceb6-4288-87fb-587479105c7a tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:18.604010 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-dab829f7-9e3f-476d-8367-489c6e922401 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:18.612681 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-dab829f7-9e3f-476d-8367-489c6e922401 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/703afaf7-e5a4-486b-a781-4bd2e3b06981" status: 200 len: 1362 microversion: 2.1 time: 0.334383 Aug 11 11:09:18.617863 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 358/741] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:09:18 2022] GET /compute/v2.1/servers/703afaf7-e5a4-486b-a781-4bd2e3b06981 => generated 1362 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:09:18.704576 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-00848171-ceb6-4288-87fb-587479105c7a tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:18.712798 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-00848171-ceb6-4288-87fb-587479105c7a tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/7cfaa606-ef7e-4594-aaba-72be96386bd7" status: 200 len: 1520 microversion: 2.1 time: 0.192314 Aug 11 11:09:18.713380 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 384/742] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:09:18 2022] GET /compute/v2.1/servers/7cfaa606-ef7e-4594-aaba-72be96386bd7 => generated 1520 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:09:19.634925 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-b3f25d83-970f-4001-826f-a1291bd25ce0 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:19.635664 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-b3f25d83-970f-4001-826f-a1291bd25ce0 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 703afaf7-e5a4-486b-a781-4bd2e3b06981] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:19.642735 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b3f25d83-970f-4001-826f-a1291bd25ce0 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:19.643296 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b3f25d83-970f-4001-826f-a1291bd25ce0 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:19.643828 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b3f25d83-970f-4001-826f-a1291bd25ce0 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:19.644608 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b3f25d83-970f-4001-826f-a1291bd25ce0 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:19.645135 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b3f25d83-970f-4001-826f-a1291bd25ce0 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:19.645627 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b3f25d83-970f-4001-826f-a1291bd25ce0 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:19.735158 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-65bc2fe2-5c10-402a-92ec-1662ec11d439 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:19.735898 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-65bc2fe2-5c10-402a-92ec-1662ec11d439 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 7cfaa606-ef7e-4594-aaba-72be96386bd7] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:19.743181 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-65bc2fe2-5c10-402a-92ec-1662ec11d439 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:19.746128 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-65bc2fe2-5c10-402a-92ec-1662ec11d439 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:19.746128 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-65bc2fe2-5c10-402a-92ec-1662ec11d439 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:19.746128 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-65bc2fe2-5c10-402a-92ec-1662ec11d439 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:19.746128 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-65bc2fe2-5c10-402a-92ec-1662ec11d439 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:19.746505 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-65bc2fe2-5c10-402a-92ec-1662ec11d439 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:20.188838 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-b3f25d83-970f-4001-826f-a1291bd25ce0 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:20.197441 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-b3f25d83-970f-4001-826f-a1291bd25ce0 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/703afaf7-e5a4-486b-a781-4bd2e3b06981" status: 200 len: 1362 microversion: 2.1 time: 0.566558 Aug 11 11:09:20.198182 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 359/743] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:09:19 2022] GET /compute/v2.1/servers/703afaf7-e5a4-486b-a781-4bd2e3b06981 => generated 1362 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:09:20.247184 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-65bc2fe2-5c10-402a-92ec-1662ec11d439 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:20.255189 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-65bc2fe2-5c10-402a-92ec-1662ec11d439 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/7cfaa606-ef7e-4594-aaba-72be96386bd7" status: 200 len: 1520 microversion: 2.1 time: 0.524149 Aug 11 11:09:20.255784 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 385/744] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:09:19 2022] GET /compute/v2.1/servers/7cfaa606-ef7e-4594-aaba-72be96386bd7 => generated 1520 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:09:20.550016 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-497315dd-43d8-40fd-a9de-45f9b62aa3c8 req-b20c8d53-aa82-4ce6-8ec6-48063f41d635 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7cfaa606-ef7e-4594-aaba-72be96386bd7", "name": "network-vif-deleted", "tag": "62264662-0d46-4c8b-8645-6e11bfc09892"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:09:20.561788 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-497315dd-43d8-40fd-a9de-45f9b62aa3c8 req-b20c8d53-aa82-4ce6-8ec6-48063f41d635 service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:20.563001 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-497315dd-43d8-40fd-a9de-45f9b62aa3c8 req-b20c8d53-aa82-4ce6-8ec6-48063f41d635 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:20.563462 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-497315dd-43d8-40fd-a9de-45f9b62aa3c8 req-b20c8d53-aa82-4ce6-8ec6-48063f41d635 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:20.576142 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-497315dd-43d8-40fd-a9de-45f9b62aa3c8 req-b20c8d53-aa82-4ce6-8ec6-48063f41d635 service nova] Creating event network-vif-deleted:62264662-0d46-4c8b-8645-6e11bfc09892 for instance 7cfaa606-ef7e-4594-aaba-72be96386bd7 on hv-cinder-82002 Aug 11 11:09:20.582357 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-497315dd-43d8-40fd-a9de-45f9b62aa3c8 req-b20c8d53-aa82-4ce6-8ec6-48063f41d635 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036469 Aug 11 11:09:20.583084 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 360/745] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:09:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:09:21.217597 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-09bae920-f0ce-4282-9586-72f2e0c7c410 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:21.218888 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-09bae920-f0ce-4282-9586-72f2e0c7c410 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 703afaf7-e5a4-486b-a781-4bd2e3b06981] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:21.227965 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-09bae920-f0ce-4282-9586-72f2e0c7c410 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:21.227965 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-09bae920-f0ce-4282-9586-72f2e0c7c410 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:21.227965 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-09bae920-f0ce-4282-9586-72f2e0c7c410 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:21.227965 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-09bae920-f0ce-4282-9586-72f2e0c7c410 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:21.228408 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-09bae920-f0ce-4282-9586-72f2e0c7c410 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:21.228739 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-09bae920-f0ce-4282-9586-72f2e0c7c410 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:21.278281 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-b35c6176-ea25-474c-aa45-b1805e4f2d08 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:21.279604 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-b35c6176-ea25-474c-aa45-b1805e4f2d08 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 7cfaa606-ef7e-4594-aaba-72be96386bd7] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:21.287426 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b35c6176-ea25-474c-aa45-b1805e4f2d08 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:21.288694 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b35c6176-ea25-474c-aa45-b1805e4f2d08 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:21.290789 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b35c6176-ea25-474c-aa45-b1805e4f2d08 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:21.292062 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b35c6176-ea25-474c-aa45-b1805e4f2d08 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:21.292062 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b35c6176-ea25-474c-aa45-b1805e4f2d08 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:21.292413 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b35c6176-ea25-474c-aa45-b1805e4f2d08 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:21.351681 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b35c6176-ea25-474c-aa45-b1805e4f2d08 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:21.352451 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b35c6176-ea25-474c-aa45-b1805e4f2d08 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:21.353542 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b35c6176-ea25-474c-aa45-b1805e4f2d08 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:21.354213 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.objects.instance [None req-b35c6176-ea25-474c-aa45-b1805e4f2d08 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lazy-loading 'fault' on Instance uuid 7cfaa606-ef7e-4594-aaba-72be96386bd7 {{(pid=121231) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 11:09:21.423811 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-b35c6176-ea25-474c-aa45-b1805e4f2d08 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '684d59041e82466d8aad6d2964842bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8751d4bd74240db9b57b7e9f788df94', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:21.452337 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-b35c6176-ea25-474c-aa45-b1805e4f2d08 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/7cfaa606-ef7e-4594-aaba-72be96386bd7" status: 200 len: 1311 microversion: 2.1 time: 0.179206 Aug 11 11:09:21.466245 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-09bae920-f0ce-4282-9586-72f2e0c7c410 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:21.466245 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-09bae920-f0ce-4282-9586-72f2e0c7c410 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/703afaf7-e5a4-486b-a781-4bd2e3b06981" status: 200 len: 1362 microversion: 2.1 time: 0.251842 Aug 11 11:09:21.466245 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 386/746] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:09:21 2022] GET /compute/v2.1/servers/703afaf7-e5a4-486b-a781-4bd2e3b06981 => generated 1362 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:09:21.468933 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 361/747] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:09:21 2022] GET /compute/v2.1/servers/7cfaa606-ef7e-4594-aaba-72be96386bd7 => generated 1311 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:09:21.922912 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-9b3d262c-f19d-4a8b-843c-a2be42a3899e tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-672388075", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-614059539", "security_groups": [{"name": "tempest-secgroup-smoke-879638545"}], "block_device_mapping_v2": [{"uuid": "ce5edff3-29c9-4c64-a8ef-4685e9aa2684", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1386703a-61b7-4e13-98b7-ce04b934949c"}]}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:09:22.060684 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.network.neutron [None req-9b3d262c-f19d-4a8b-843c-a2be42a3899e tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] validate_networks() for [('1386703a-61b7-4e13-98b7-ce04b934949c', None, None, None, None, None)] {{(pid=121232) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 11 11:09:22.474764 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-5b435ded-034e-4034-8cc7-31f05fbb2734 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:22.476063 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-5b435ded-034e-4034-8cc7-31f05fbb2734 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] [instance: 7cfaa606-ef7e-4594-aaba-72be96386bd7] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:22.487381 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5b435ded-034e-4034-8cc7-31f05fbb2734 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:22.488835 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5b435ded-034e-4034-8cc7-31f05fbb2734 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:22.489458 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5b435ded-034e-4034-8cc7-31f05fbb2734 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:22.490334 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5b435ded-034e-4034-8cc7-31f05fbb2734 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:22.491126 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5b435ded-034e-4034-8cc7-31f05fbb2734 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:22.491727 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5b435ded-034e-4034-8cc7-31f05fbb2734 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:22.506102 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.wsgi [None req-5b435ded-034e-4034-8cc7-31f05fbb2734 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] HTTP exception thrown: Instance 7cfaa606-ef7e-4594-aaba-72be96386bd7 could not be found. Aug 11 11:09:22.513126 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-5b435ded-034e-4034-8cc7-31f05fbb2734 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Request method failure captured: Aug 11 11:09:22.513126 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: request: GET /compute/v2.1/servers/7cfaa606-ef7e-4594-aaba-72be96386bd7 HTTP/1.1 Aug 11 11:09:22.513126 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Accept: application/json Aug 11 11:09:22.513126 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Accept-Encoding: identity Aug 11 11:09:22.513126 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Connection: close Aug 11 11:09:22.513126 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Content-Length: 0 Aug 11 11:09:22.513126 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Content-Type: application/json Aug 11 11:09:22.513126 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Host: 10.222.0.48 Aug 11 11:09:22.513126 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Openstack-System-Scope: None Aug 11 11:09:22.513126 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: User-Agent: python-urllib3/1.26.11 Aug 11 11:09:22.513126 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Auth-Token: gAAAAABi9OIZrQLD9wcn33oOAILRLRgizejVjH27hxki3e7YaqpWc9w5AB6twcQbo6ujH2ticAWA98YJt2oEA_0zpX3GqgJkSqqHfHltxhU9T4SgJ_YQxUiy9cMGURf0wSoT5Vg71mc-C9U7FKhPy_DOheOZskafHmoddANNVZO-sZBS_1qYvI4 Aug 11 11:09:22.513126 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Domain-Id: None Aug 11 11:09:22.513126 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Domain-Name: None Aug 11 11:09:22.513126 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Identity-Status: Confirmed Aug 11 11:09:22.513126 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Is-Admin-Project: True Aug 11 11:09:22.513126 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Domain-Id: default Aug 11 11:09:22.513126 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Domain-Name: Default Aug 11 11:09:22.513126 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Id: e8751d4bd74240db9b57b7e9f788df94 Aug 11 11:09:22.513126 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1157402601 Aug 11 11:09:22.513126 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Role: reader,member Aug 11 11:09:22.513126 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Roles: reader,member Aug 11 11:09:22.514928 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e8751d4bd74240db9b57b7e9f788df94"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/e8751d4bd74240db9b57b7e9f788df94"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/e8751d4bd74240db9b57b7e9f788df94"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_e8751d4bd74240db9b57b7e9f788df94", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] Aug 11 11:09:22.514928 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1157402601 Aug 11 11:09:22.514928 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant-Id: e8751d4bd74240db9b57b7e9f788df94 Aug 11 11:09:22.514928 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1157402601 Aug 11 11:09:22.514928 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User: tempest-ServerRescueNegativeTestJSON-1157402601-project Aug 11 11:09:22.514928 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Domain-Id: default Aug 11 11:09:22.514928 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Domain-Name: Default Aug 11 11:09:22.514928 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Id: 684d59041e82466d8aad6d2964842bf5 Aug 11 11:09:22.514928 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1157402601-project Aug 11 11:09:22.514928 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: method: > Aug 11 11:09:22.514928 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: exception: Instance 7cfaa606-ef7e-4594-aaba-72be96386bd7 could not be found. Aug 11 11:09:22.514928 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: action_args: {'id': '7cfaa606-ef7e-4594-aaba-72be96386bd7'} Aug 11 11:09:22.519719 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 11:09:22.519719 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:09:22.519719 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 11:09:22.519719 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 11:09:22.519719 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 11:09:22.519719 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 11:09:22.519719 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 11:09:22.519719 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 11:09:22.519719 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 11:09:22.519719 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 11:09:22.519719 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7cfaa606-ef7e-4594-aaba-72be96386bd7 could not be found. Aug 11 11:09:22.519719 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:09:22.519719 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:09:22.519719 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:09:22.519719 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:09:22.519719 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:09:22.519719 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:09:22.519719 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 11:09:22.519719 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 11:09:22.519719 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 11:09:22.521438 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 11:09:22.521438 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 11:09:22.521438 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 11:09:22.521438 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 11:09:22.521438 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 11:09:22.521438 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 11:09:22.521438 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 11:09:22.521438 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7cfaa606-ef7e-4594-aaba-72be96386bd7 could not be found. Aug 11 11:09:22.521438 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:09:22.521438 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:09:22.521438 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:09:22.521438 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:09:22.521438 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:09:22.521438 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:09:22.521438 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 11:09:22.521438 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 11:09:22.521438 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7cfaa606-ef7e-4594-aaba-72be96386bd7 could not be found. Aug 11 11:09:22.521438 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:09:22.522734 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-5b435ded-034e-4034-8cc7-31f05fbb2734 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] Returning 404 to user: Instance 7cfaa606-ef7e-4594-aaba-72be96386bd7 could not be found. {{(pid=121231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 11:09:22.522734 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-5b435ded-034e-4034-8cc7-31f05fbb2734 tempest-ServerRescueNegativeTestJSON-1157402601 tempest-ServerRescueNegativeTestJSON-1157402601-project] 10.222.0.48 "GET /compute/v2.1/servers/7cfaa606-ef7e-4594-aaba-72be96386bd7" status: 404 len: 111 microversion: 2.1 time: 0.044034 Aug 11 11:09:22.522904 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-9b3d262c-f19d-4a8b-843c-a2be42a3899e tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Flavor limits 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 11 11:09:22.522904 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-9b3d262c-f19d-4a8b-843c-a2be42a3899e tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Image limits 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 11 11:09:22.522904 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-9b3d262c-f19d-4a8b-843c-a2be42a3899e tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Flavor pref 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 11 11:09:22.522904 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-9b3d262c-f19d-4a8b-843c-a2be42a3899e tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Image pref 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 11 11:09:22.523512 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 362/748] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:09:22 2022] GET /compute/v2.1/servers/7cfaa606-ef7e-4594-aaba-72be96386bd7 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 11:09:22.523604 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-9b3d262c-f19d-4a8b-843c-a2be42a3899e tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 11 11:09:22.524330 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-e7baf301-d46a-4241-89f1-7829bfb55081 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:22.524985 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-e7baf301-d46a-4241-89f1-7829bfb55081 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 703afaf7-e5a4-486b-a781-4bd2e3b06981] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:22.532339 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e7baf301-d46a-4241-89f1-7829bfb55081 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:22.532817 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e7baf301-d46a-4241-89f1-7829bfb55081 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:22.533253 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e7baf301-d46a-4241-89f1-7829bfb55081 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:22.533952 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e7baf301-d46a-4241-89f1-7829bfb55081 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:22.534627 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e7baf301-d46a-4241-89f1-7829bfb55081 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:22.535030 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e7baf301-d46a-4241-89f1-7829bfb55081 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:22.541941 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9b3d262c-f19d-4a8b-843c-a2be42a3899e tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:22.542541 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9b3d262c-f19d-4a8b-843c-a2be42a3899e tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:22.542965 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9b3d262c-f19d-4a8b-843c-a2be42a3899e tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:22.543680 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9b3d262c-f19d-4a8b-843c-a2be42a3899e tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:22.544415 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9b3d262c-f19d-4a8b-843c-a2be42a3899e tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:22.544849 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9b3d262c-f19d-4a8b-843c-a2be42a3899e tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:22.564543 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-9b3d262c-f19d-4a8b-843c-a2be42a3899e tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Getting quotas for project b1d394882f294c6283721bcc6f8ff04d. Resources: {'ram', 'cores', 'instances'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 11:09:22.568956 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-9b3d262c-f19d-4a8b-843c-a2be42a3899e tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Getting quotas for user 2a9dbe3b7fdd482681b6ab94c26f4e71 and project b1d394882f294c6283721bcc6f8ff04d. Resources: {'ram', 'cores', 'instances'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 11:09:22.646824 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-9b3d262c-f19d-4a8b-843c-a2be42a3899e tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Going to run 1 instances... {{(pid=121232) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 11 11:09:22.649020 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-9b3d262c-f19d-4a8b-843c-a2be42a3899e tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: d1cc9961-0393-433e-9c87-cdd2b8457a85] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ce5edff3-29c9-4c64-a8ef-4685e9aa2684',volume_size=None,volume_type=None)] {{(pid=121232) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 11 11:09:22.694482 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-e7baf301-d46a-4241-89f1-7829bfb55081 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:22.711574 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-e7baf301-d46a-4241-89f1-7829bfb55081 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/703afaf7-e5a4-486b-a781-4bd2e3b06981" status: 200 len: 1362 microversion: 2.1 time: 0.181321 Aug 11 11:09:22.711574 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 363/749] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:09:22 2022] GET /compute/v2.1/servers/703afaf7-e5a4-486b-a781-4bd2e3b06981 => generated 1362 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:09:23.100280 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-9b3d262c-f19d-4a8b-843c-a2be42a3899e tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.182724 Aug 11 11:09:23.101305 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 387/750] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Aug 11 11:09:21 2022] POST /compute/v2.1/servers => generated 405 bytes in 1185 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 11 11:09:23.112655 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-cdc3b6c9-732e-4ce7-99ba-45972b098c20 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:23.113489 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-cdc3b6c9-732e-4ce7-99ba-45972b098c20 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: d1cc9961-0393-433e-9c87-cdd2b8457a85] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:23.203707 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-cdc3b6c9-732e-4ce7-99ba-45972b098c20 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9dbe3b7fdd482681b6ab94c26f4e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d394882f294c6283721bcc6f8ff04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:23.213417 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-cdc3b6c9-732e-4ce7-99ba-45972b098c20 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "GET /compute/v2.1/servers/d1cc9961-0393-433e-9c87-cdd2b8457a85" status: 200 len: 1093 microversion: 2.1 time: 0.104085 Aug 11 11:09:23.216002 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 364/751] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:09:23 2022] GET /compute/v2.1/servers/d1cc9961-0393-433e-9c87-cdd2b8457a85 => generated 1093 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:09:23.524366 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-acd7a758-2ae9-4913-9b1b-c274abd48b6a req-74403961-7f0f-46ce-860a-4d9f65a00e7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "703afaf7-e5a4-486b-a781-4bd2e3b06981", "name": "network-vif-plugged", "status": "completed", "tag": "03264dbf-1d91-494b-b399-8a502d9530a4"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:09:23.542272 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-acd7a758-2ae9-4913-9b1b-c274abd48b6a req-74403961-7f0f-46ce-860a-4d9f65a00e7b service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:23.542272 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-acd7a758-2ae9-4913-9b1b-c274abd48b6a req-74403961-7f0f-46ce-860a-4d9f65a00e7b service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:23.542272 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-acd7a758-2ae9-4913-9b1b-c274abd48b6a req-74403961-7f0f-46ce-860a-4d9f65a00e7b service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:23.548998 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-acd7a758-2ae9-4913-9b1b-c274abd48b6a req-74403961-7f0f-46ce-860a-4d9f65a00e7b service nova] Creating event network-vif-plugged:03264dbf-1d91-494b-b399-8a502d9530a4 for instance 703afaf7-e5a4-486b-a781-4bd2e3b06981 on hv-cinder-82002 Aug 11 11:09:23.554784 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-acd7a758-2ae9-4913-9b1b-c274abd48b6a req-74403961-7f0f-46ce-860a-4d9f65a00e7b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034200 Aug 11 11:09:23.555417 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 388/752] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:09:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 11:09:23.723461 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-39639442-1360-4785-854d-2620bb67eed4 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:23.735705 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-39639442-1360-4785-854d-2620bb67eed4 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 703afaf7-e5a4-486b-a781-4bd2e3b06981] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:23.735705 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-39639442-1360-4785-854d-2620bb67eed4 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:23.735705 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-39639442-1360-4785-854d-2620bb67eed4 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:23.735705 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-39639442-1360-4785-854d-2620bb67eed4 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:23.736353 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-39639442-1360-4785-854d-2620bb67eed4 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:23.736353 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-39639442-1360-4785-854d-2620bb67eed4 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:23.736353 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-39639442-1360-4785-854d-2620bb67eed4 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:23.880170 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-39639442-1360-4785-854d-2620bb67eed4 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:23.888595 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-39639442-1360-4785-854d-2620bb67eed4 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/703afaf7-e5a4-486b-a781-4bd2e3b06981" status: 200 len: 1362 microversion: 2.1 time: 0.169402 Aug 11 11:09:23.889175 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 365/753] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:09:23 2022] GET /compute/v2.1/servers/703afaf7-e5a4-486b-a781-4bd2e3b06981 => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:09:24.238177 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-4a3cb5a7-d8bb-4858-84dc-adb0ceebf35b tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:24.239326 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-4a3cb5a7-d8bb-4858-84dc-adb0ceebf35b tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: d1cc9961-0393-433e-9c87-cdd2b8457a85] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:24.307329 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-4a3cb5a7-d8bb-4858-84dc-adb0ceebf35b tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9dbe3b7fdd482681b6ab94c26f4e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d394882f294c6283721bcc6f8ff04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:24.316442 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-4a3cb5a7-d8bb-4858-84dc-adb0ceebf35b tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "GET /compute/v2.1/servers/d1cc9961-0393-433e-9c87-cdd2b8457a85" status: 200 len: 1093 microversion: 2.1 time: 0.083116 Aug 11 11:09:24.317380 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 389/754] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:09:24 2022] GET /compute/v2.1/servers/d1cc9961-0393-433e-9c87-cdd2b8457a85 => generated 1093 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:09:24.910831 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-b65b135f-f13b-470f-9d19-48f0ec5acaf8 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:24.911441 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-b65b135f-f13b-470f-9d19-48f0ec5acaf8 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 703afaf7-e5a4-486b-a781-4bd2e3b06981] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:24.921474 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b65b135f-f13b-470f-9d19-48f0ec5acaf8 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:24.922285 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b65b135f-f13b-470f-9d19-48f0ec5acaf8 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:24.922891 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b65b135f-f13b-470f-9d19-48f0ec5acaf8 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:24.924363 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b65b135f-f13b-470f-9d19-48f0ec5acaf8 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:24.925346 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b65b135f-f13b-470f-9d19-48f0ec5acaf8 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:24.926121 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b65b135f-f13b-470f-9d19-48f0ec5acaf8 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:25.088705 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-b65b135f-f13b-470f-9d19-48f0ec5acaf8 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:25.097121 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-b65b135f-f13b-470f-9d19-48f0ec5acaf8 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/703afaf7-e5a4-486b-a781-4bd2e3b06981" status: 200 len: 1362 microversion: 2.1 time: 0.190148 Aug 11 11:09:25.110223 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 366/755] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:09:24 2022] GET /compute/v2.1/servers/703afaf7-e5a4-486b-a781-4bd2e3b06981 => generated 1362 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:09:25.337605 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-6506efe5-228f-45dd-84e1-f7ed151ffb57 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:25.338194 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-6506efe5-228f-45dd-84e1-f7ed151ffb57 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: d1cc9961-0393-433e-9c87-cdd2b8457a85] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:25.345831 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6506efe5-228f-45dd-84e1-f7ed151ffb57 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:25.346318 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6506efe5-228f-45dd-84e1-f7ed151ffb57 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:25.346778 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6506efe5-228f-45dd-84e1-f7ed151ffb57 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:25.347550 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6506efe5-228f-45dd-84e1-f7ed151ffb57 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:25.347958 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6506efe5-228f-45dd-84e1-f7ed151ffb57 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:25.352150 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6506efe5-228f-45dd-84e1-f7ed151ffb57 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:25.435216 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-6506efe5-228f-45dd-84e1-f7ed151ffb57 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9dbe3b7fdd482681b6ab94c26f4e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d394882f294c6283721bcc6f8ff04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:25.443109 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-6506efe5-228f-45dd-84e1-f7ed151ffb57 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "GET /compute/v2.1/servers/d1cc9961-0393-433e-9c87-cdd2b8457a85" status: 200 len: 1135 microversion: 2.1 time: 0.109767 Aug 11 11:09:25.443712 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 390/756] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:09:25 2022] GET /compute/v2.1/servers/d1cc9961-0393-433e-9c87-cdd2b8457a85 => generated 1135 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:09:26.119151 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-3d007583-6d9a-47bb-b256-3fff0d5a10ec tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:26.120454 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-3d007583-6d9a-47bb-b256-3fff0d5a10ec tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 703afaf7-e5a4-486b-a781-4bd2e3b06981] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:26.127936 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3d007583-6d9a-47bb-b256-3fff0d5a10ec tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:26.128567 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3d007583-6d9a-47bb-b256-3fff0d5a10ec tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:26.129304 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3d007583-6d9a-47bb-b256-3fff0d5a10ec tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:26.130009 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3d007583-6d9a-47bb-b256-3fff0d5a10ec tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:26.131120 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3d007583-6d9a-47bb-b256-3fff0d5a10ec tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:26.131584 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3d007583-6d9a-47bb-b256-3fff0d5a10ec tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:26.281786 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-3d007583-6d9a-47bb-b256-3fff0d5a10ec tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:26.289457 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-3d007583-6d9a-47bb-b256-3fff0d5a10ec tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/703afaf7-e5a4-486b-a781-4bd2e3b06981" status: 200 len: 1549 microversion: 2.1 time: 0.174742 Aug 11 11:09:26.290034 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 367/757] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:09:26 2022] GET /compute/v2.1/servers/703afaf7-e5a4-486b-a781-4bd2e3b06981 => generated 1549 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:09:26.310221 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-4c965104-238a-4931-aea1-99ef5fcd179d tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:26.310715 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-4c965104-238a-4931-aea1-99ef5fcd179d tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 703afaf7-e5a4-486b-a781-4bd2e3b06981] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:26.316691 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4c965104-238a-4931-aea1-99ef5fcd179d tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:26.317171 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4c965104-238a-4931-aea1-99ef5fcd179d tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:26.317609 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4c965104-238a-4931-aea1-99ef5fcd179d tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:26.318294 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4c965104-238a-4931-aea1-99ef5fcd179d tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:26.318747 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4c965104-238a-4931-aea1-99ef5fcd179d tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:26.319168 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4c965104-238a-4931-aea1-99ef5fcd179d tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:26.417182 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-4c965104-238a-4931-aea1-99ef5fcd179d tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/703afaf7-e5a4-486b-a781-4bd2e3b06981/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.110794 Aug 11 11:09:26.418088 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 391/758] 10.222.0.48 () {58 vars in 1275 bytes} [Thu Aug 11 11:09:26 2022] GET /compute/v2.1/servers/703afaf7-e5a4-486b-a781-4bd2e3b06981/os-interface => generated 285 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:09:26.464057 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-24d9a8fc-d289-4712-8bf0-a44694717e70 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:26.467105 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-24d9a8fc-d289-4712-8bf0-a44694717e70 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: d1cc9961-0393-433e-9c87-cdd2b8457a85] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:26.471824 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-24d9a8fc-d289-4712-8bf0-a44694717e70 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:26.489483 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-24d9a8fc-d289-4712-8bf0-a44694717e70 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:26.490422 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-24d9a8fc-d289-4712-8bf0-a44694717e70 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:26.492542 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-24d9a8fc-d289-4712-8bf0-a44694717e70 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:26.493227 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-24d9a8fc-d289-4712-8bf0-a44694717e70 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:26.493840 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-24d9a8fc-d289-4712-8bf0-a44694717e70 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:26.611560 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-24d9a8fc-d289-4712-8bf0-a44694717e70 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9dbe3b7fdd482681b6ab94c26f4e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d394882f294c6283721bcc6f8ff04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:26.620242 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-24d9a8fc-d289-4712-8bf0-a44694717e70 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "GET /compute/v2.1/servers/d1cc9961-0393-433e-9c87-cdd2b8457a85" status: 200 len: 1191 microversion: 2.1 time: 0.159927 Aug 11 11:09:26.623138 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 368/759] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:09:26 2022] GET /compute/v2.1/servers/d1cc9961-0393-433e-9c87-cdd2b8457a85 => generated 1191 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:09:27.645421 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-306cc13c-c065-4b18-9046-e4f6744bebf3 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:27.646024 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-306cc13c-c065-4b18-9046-e4f6744bebf3 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: d1cc9961-0393-433e-9c87-cdd2b8457a85] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:27.652033 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-306cc13c-c065-4b18-9046-e4f6744bebf3 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:27.652512 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-306cc13c-c065-4b18-9046-e4f6744bebf3 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:27.652941 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-306cc13c-c065-4b18-9046-e4f6744bebf3 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:27.653617 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-306cc13c-c065-4b18-9046-e4f6744bebf3 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:27.654083 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-306cc13c-c065-4b18-9046-e4f6744bebf3 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:27.654497 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-306cc13c-c065-4b18-9046-e4f6744bebf3 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:27.773552 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-306cc13c-c065-4b18-9046-e4f6744bebf3 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9dbe3b7fdd482681b6ab94c26f4e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d394882f294c6283721bcc6f8ff04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:27.781305 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-306cc13c-c065-4b18-9046-e4f6744bebf3 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "GET /compute/v2.1/servers/d1cc9961-0393-433e-9c87-cdd2b8457a85" status: 200 len: 1209 microversion: 2.1 time: 0.140234 Aug 11 11:09:27.781894 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 392/760] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:09:27 2022] GET /compute/v2.1/servers/d1cc9961-0393-433e-9c87-cdd2b8457a85 => generated 1209 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:09:28.679466 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-253e8638-bc70-4284-8682-b3fc5b4f8763 req-e0dae737-4654-4872-9eb7-f4c2a0f52bc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "703afaf7-e5a4-486b-a781-4bd2e3b06981", "tag": "03264dbf-1d91-494b-b399-8a502d9530a4"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:09:28.711636 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-253e8638-bc70-4284-8682-b3fc5b4f8763 req-e0dae737-4654-4872-9eb7-f4c2a0f52bc0 service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:28.714553 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-253e8638-bc70-4284-8682-b3fc5b4f8763 req-e0dae737-4654-4872-9eb7-f4c2a0f52bc0 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:28.715440 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-253e8638-bc70-4284-8682-b3fc5b4f8763 req-e0dae737-4654-4872-9eb7-f4c2a0f52bc0 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:28.789078 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-253e8638-bc70-4284-8682-b3fc5b4f8763 req-e0dae737-4654-4872-9eb7-f4c2a0f52bc0 service nova] Creating event network-changed:03264dbf-1d91-494b-b399-8a502d9530a4 for instance 703afaf7-e5a4-486b-a781-4bd2e3b06981 on hv-cinder-82002 Aug 11 11:09:28.800881 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-253e8638-bc70-4284-8682-b3fc5b4f8763 req-e0dae737-4654-4872-9eb7-f4c2a0f52bc0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123265 Aug 11 11:09:28.802851 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 369/761] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:09:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:09:28.811873 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-674a1735-96ad-4d59-a9b6-9652b4537947 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:28.813354 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-674a1735-96ad-4d59-a9b6-9652b4537947 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: d1cc9961-0393-433e-9c87-cdd2b8457a85] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:28.821932 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-674a1735-96ad-4d59-a9b6-9652b4537947 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:28.822551 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-674a1735-96ad-4d59-a9b6-9652b4537947 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:28.823200 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-674a1735-96ad-4d59-a9b6-9652b4537947 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:28.824150 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-674a1735-96ad-4d59-a9b6-9652b4537947 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:28.824698 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-674a1735-96ad-4d59-a9b6-9652b4537947 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:28.825481 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-674a1735-96ad-4d59-a9b6-9652b4537947 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:28.831373 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=100 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:09:29.125475 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-674a1735-96ad-4d59-a9b6-9652b4537947 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9dbe3b7fdd482681b6ab94c26f4e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d394882f294c6283721bcc6f8ff04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:29.133927 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-674a1735-96ad-4d59-a9b6-9652b4537947 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "GET /compute/v2.1/servers/d1cc9961-0393-433e-9c87-cdd2b8457a85" status: 200 len: 1276 microversion: 2.1 time: 0.333447 Aug 11 11:09:29.148133 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 393/762] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:09:28 2022] GET /compute/v2.1/servers/d1cc9961-0393-433e-9c87-cdd2b8457a85 => generated 1276 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:09:30.156176 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-9b8382ab-af15-4058-8595-b9687ff7cdf1 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:30.157349 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-9b8382ab-af15-4058-8595-b9687ff7cdf1 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: d1cc9961-0393-433e-9c87-cdd2b8457a85] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:30.183346 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9b8382ab-af15-4058-8595-b9687ff7cdf1 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:30.189041 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9b8382ab-af15-4058-8595-b9687ff7cdf1 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:30.190635 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9b8382ab-af15-4058-8595-b9687ff7cdf1 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:30.192171 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9b8382ab-af15-4058-8595-b9687ff7cdf1 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:30.193894 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9b8382ab-af15-4058-8595-b9687ff7cdf1 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:30.195630 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9b8382ab-af15-4058-8595-b9687ff7cdf1 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:30.229283 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:09:30.484871 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-9b8382ab-af15-4058-8595-b9687ff7cdf1 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9dbe3b7fdd482681b6ab94c26f4e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d394882f294c6283721bcc6f8ff04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:30.494147 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-9b8382ab-af15-4058-8595-b9687ff7cdf1 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "GET /compute/v2.1/servers/d1cc9961-0393-433e-9c87-cdd2b8457a85" status: 200 len: 1264 microversion: 2.1 time: 0.343164 Aug 11 11:09:30.494726 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 370/763] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:09:30 2022] GET /compute/v2.1/servers/d1cc9961-0393-433e-9c87-cdd2b8457a85 => generated 1264 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:09:30.832025 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-be86eccd-7557-4a46-b5b4-d9838e381ffb req-24edd834-47a0-4ddc-b340-b1ff3d69fdb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1cc9961-0393-433e-9c87-cdd2b8457a85", "tag": "965e09f5-4bf9-4eeb-b7ca-f1b072b67e41"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:09:30.844082 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-be86eccd-7557-4a46-b5b4-d9838e381ffb req-24edd834-47a0-4ddc-b340-b1ff3d69fdb4 service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:30.844652 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-be86eccd-7557-4a46-b5b4-d9838e381ffb req-24edd834-47a0-4ddc-b340-b1ff3d69fdb4 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:30.845390 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-be86eccd-7557-4a46-b5b4-d9838e381ffb req-24edd834-47a0-4ddc-b340-b1ff3d69fdb4 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:30.857856 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-be86eccd-7557-4a46-b5b4-d9838e381ffb req-24edd834-47a0-4ddc-b340-b1ff3d69fdb4 service nova] Creating event network-changed:965e09f5-4bf9-4eeb-b7ca-f1b072b67e41 for instance d1cc9961-0393-433e-9c87-cdd2b8457a85 on hv-cinder-82002 Aug 11 11:09:30.863609 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-be86eccd-7557-4a46-b5b4-d9838e381ffb req-24edd834-47a0-4ddc-b340-b1ff3d69fdb4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035510 Aug 11 11:09:30.864435 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 394/764] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:09:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 11:09:31.516009 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-3c448ea7-4058-4669-8c88-d06be26bf881 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:31.516601 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-3c448ea7-4058-4669-8c88-d06be26bf881 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: d1cc9961-0393-433e-9c87-cdd2b8457a85] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:31.531859 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3c448ea7-4058-4669-8c88-d06be26bf881 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:31.532669 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3c448ea7-4058-4669-8c88-d06be26bf881 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:31.533270 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3c448ea7-4058-4669-8c88-d06be26bf881 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:31.534145 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3c448ea7-4058-4669-8c88-d06be26bf881 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:31.534756 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3c448ea7-4058-4669-8c88-d06be26bf881 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:31.541938 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3c448ea7-4058-4669-8c88-d06be26bf881 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:31.891250 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-3c448ea7-4058-4669-8c88-d06be26bf881 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9dbe3b7fdd482681b6ab94c26f4e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d394882f294c6283721bcc6f8ff04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:31.903355 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-3c448ea7-4058-4669-8c88-d06be26bf881 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "GET /compute/v2.1/servers/d1cc9961-0393-433e-9c87-cdd2b8457a85" status: 200 len: 1264 microversion: 2.1 time: 0.391199 Aug 11 11:09:31.904459 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 371/765] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:09:31 2022] GET /compute/v2.1/servers/d1cc9961-0393-433e-9c87-cdd2b8457a85 => generated 1264 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:09:32.930081 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-46b76d80-0279-4e4e-a92e-4e54e803aa13 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:32.932484 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-46b76d80-0279-4e4e-a92e-4e54e803aa13 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: d1cc9961-0393-433e-9c87-cdd2b8457a85] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:32.946827 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell0:SELECT=2 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:09:32.950228 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-46b76d80-0279-4e4e-a92e-4e54e803aa13 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:32.951177 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-46b76d80-0279-4e4e-a92e-4e54e803aa13 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:32.952221 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-46b76d80-0279-4e4e-a92e-4e54e803aa13 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:32.953117 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-46b76d80-0279-4e4e-a92e-4e54e803aa13 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:32.953810 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-46b76d80-0279-4e4e-a92e-4e54e803aa13 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:32.954695 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-46b76d80-0279-4e4e-a92e-4e54e803aa13 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:33.173472 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-46b76d80-0279-4e4e-a92e-4e54e803aa13 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9dbe3b7fdd482681b6ab94c26f4e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d394882f294c6283721bcc6f8ff04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:33.186781 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-46b76d80-0279-4e4e-a92e-4e54e803aa13 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "GET /compute/v2.1/servers/d1cc9961-0393-433e-9c87-cdd2b8457a85" status: 200 len: 1264 microversion: 2.1 time: 0.262286 Aug 11 11:09:33.188589 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 395/766] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:09:32 2022] GET /compute/v2.1/servers/d1cc9961-0393-433e-9c87-cdd2b8457a85 => generated 1264 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:09:34.209818 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-99bed488-910d-4a8c-becc-4590b5f43e85 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:34.210714 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-99bed488-910d-4a8c-becc-4590b5f43e85 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: d1cc9961-0393-433e-9c87-cdd2b8457a85] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:34.228260 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell0:SELECT=2 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:09:34.230389 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-99bed488-910d-4a8c-becc-4590b5f43e85 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:34.230891 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-99bed488-910d-4a8c-becc-4590b5f43e85 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:34.232096 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-99bed488-910d-4a8c-becc-4590b5f43e85 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:34.233710 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-99bed488-910d-4a8c-becc-4590b5f43e85 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:34.234335 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-99bed488-910d-4a8c-becc-4590b5f43e85 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:34.235604 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-99bed488-910d-4a8c-becc-4590b5f43e85 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:34.875325 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-99bed488-910d-4a8c-becc-4590b5f43e85 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9dbe3b7fdd482681b6ab94c26f4e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d394882f294c6283721bcc6f8ff04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:34.884180 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-99bed488-910d-4a8c-becc-4590b5f43e85 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "GET /compute/v2.1/servers/d1cc9961-0393-433e-9c87-cdd2b8457a85" status: 200 len: 1264 microversion: 2.1 time: 0.679307 Aug 11 11:09:34.895718 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 372/767] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:09:34 2022] GET /compute/v2.1/servers/d1cc9961-0393-433e-9c87-cdd2b8457a85 => generated 1264 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:09:35.909598 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-c4326e5f-bdba-467e-aabb-fc177fa700f9 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:35.910362 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-c4326e5f-bdba-467e-aabb-fc177fa700f9 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: d1cc9961-0393-433e-9c87-cdd2b8457a85] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:35.924931 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell0:SELECT=8 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:09:35.932888 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c4326e5f-bdba-467e-aabb-fc177fa700f9 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:35.934544 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c4326e5f-bdba-467e-aabb-fc177fa700f9 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:35.935208 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c4326e5f-bdba-467e-aabb-fc177fa700f9 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:35.937746 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c4326e5f-bdba-467e-aabb-fc177fa700f9 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:35.941025 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c4326e5f-bdba-467e-aabb-fc177fa700f9 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:35.941744 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c4326e5f-bdba-467e-aabb-fc177fa700f9 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:36.306801 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-c4326e5f-bdba-467e-aabb-fc177fa700f9 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9dbe3b7fdd482681b6ab94c26f4e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d394882f294c6283721bcc6f8ff04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:36.318415 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-c4326e5f-bdba-467e-aabb-fc177fa700f9 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "GET /compute/v2.1/servers/d1cc9961-0393-433e-9c87-cdd2b8457a85" status: 200 len: 1264 microversion: 2.1 time: 0.414608 Aug 11 11:09:36.319014 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 396/768] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:09:35 2022] GET /compute/v2.1/servers/d1cc9961-0393-433e-9c87-cdd2b8457a85 => generated 1264 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:09:36.967794 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-e22e74ab-624d-4f2c-a4f0-7d628da231e4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:36.975875 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-e22e74ab-624d-4f2c-a4f0-7d628da231e4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: ab871db0-6362-4dd3-b29c-b513351e027b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:36.987485 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e22e74ab-624d-4f2c-a4f0-7d628da231e4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:36.988012 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e22e74ab-624d-4f2c-a4f0-7d628da231e4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:36.988457 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e22e74ab-624d-4f2c-a4f0-7d628da231e4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:36.989180 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e22e74ab-624d-4f2c-a4f0-7d628da231e4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:36.994557 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e22e74ab-624d-4f2c-a4f0-7d628da231e4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:36.995439 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e22e74ab-624d-4f2c-a4f0-7d628da231e4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:37.027205 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-e22e74ab-624d-4f2c-a4f0-7d628da231e4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b/ips" status: 200 len: 151 microversion: 2.20 time: 0.413880 Aug 11 11:09:37.044135 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 373/769] 10.222.0.48 () {60 vars in 1289 bytes} [Thu Aug 11 11:09:36 2022] GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b/ips => generated 151 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 11:09:37.340614 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-b26d1efb-d154-4859-8a5c-38fd038e8b8c tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:37.342032 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-b26d1efb-d154-4859-8a5c-38fd038e8b8c tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: d1cc9961-0393-433e-9c87-cdd2b8457a85] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:37.352392 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b26d1efb-d154-4859-8a5c-38fd038e8b8c tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:37.353295 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b26d1efb-d154-4859-8a5c-38fd038e8b8c tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:37.354270 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b26d1efb-d154-4859-8a5c-38fd038e8b8c tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:37.356576 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b26d1efb-d154-4859-8a5c-38fd038e8b8c tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:37.357763 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b26d1efb-d154-4859-8a5c-38fd038e8b8c tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:37.358626 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b26d1efb-d154-4859-8a5c-38fd038e8b8c tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:37.757151 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-b26d1efb-d154-4859-8a5c-38fd038e8b8c tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9dbe3b7fdd482681b6ab94c26f4e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d394882f294c6283721bcc6f8ff04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:37.760465 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-b26d1efb-d154-4859-8a5c-38fd038e8b8c tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "GET /compute/v2.1/servers/d1cc9961-0393-433e-9c87-cdd2b8457a85" status: 200 len: 1264 microversion: 2.1 time: 0.422710 Aug 11 11:09:37.774261 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 397/770] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:09:37 2022] GET /compute/v2.1/servers/d1cc9961-0393-433e-9c87-cdd2b8457a85 => generated 1264 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:09:37.944899 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-352ca630-1894-42a1-b8e3-d4479a476cdd tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Action: 'create', calling method: .version_select at 0x7faab096b3a0>, body: {"keypair": {"name": "tempest-keypair-1026892144", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBhe41g3Kk/6SiGnaCNg8KhUoMLE6E9piogwRkd5ZpyZAiGgni9xByy5OfLTD1MsCpVAhEnrAmWcdGbqDBxOl/Y8tkeU2js2EgDYlCdd0H5WnsFN3Yf7g5e/qFtcJ4L1Ww=="}} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:09:37.960669 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.quota [None req-352ca630-1894-42a1-b8e3-d4479a476cdd tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Getting quotas for project c56bd2a662e34a6395117027b5c28c5b. Resources: {'key_pairs'} {{(pid=121231) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 11:09:37.965156 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.quota [None req-352ca630-1894-42a1-b8e3-d4479a476cdd tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Getting quotas for user 08d81bcd5a4f43ce8b4839ee15cb163b and project c56bd2a662e34a6395117027b5c28c5b. Resources: {'key_pairs'} {{(pid=121231) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 11:09:38.094273 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-352ca630-1894-42a1-b8e3-d4479a476cdd tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.217069 Aug 11 11:09:38.095224 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 374/771] 10.222.0.48 () {60 vars in 1159 bytes} [Thu Aug 11 11:09:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:09:38.787038 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-a6decf81-2bfb-45fe-b4ee-20216c2037b2 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:38.787799 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-a6decf81-2bfb-45fe-b4ee-20216c2037b2 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: d1cc9961-0393-433e-9c87-cdd2b8457a85] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:38.801685 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a6decf81-2bfb-45fe-b4ee-20216c2037b2 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:38.803069 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a6decf81-2bfb-45fe-b4ee-20216c2037b2 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:38.804526 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a6decf81-2bfb-45fe-b4ee-20216c2037b2 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:38.806919 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a6decf81-2bfb-45fe-b4ee-20216c2037b2 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:38.806919 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a6decf81-2bfb-45fe-b4ee-20216c2037b2 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:38.806919 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a6decf81-2bfb-45fe-b4ee-20216c2037b2 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:39.089221 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-a6decf81-2bfb-45fe-b4ee-20216c2037b2 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9dbe3b7fdd482681b6ab94c26f4e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d394882f294c6283721bcc6f8ff04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:39.097234 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-a6decf81-2bfb-45fe-b4ee-20216c2037b2 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "GET /compute/v2.1/servers/d1cc9961-0393-433e-9c87-cdd2b8457a85" status: 200 len: 1264 microversion: 2.1 time: 0.315333 Aug 11 11:09:39.101575 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 398/772] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:09:38 2022] GET /compute/v2.1/servers/d1cc9961-0393-433e-9c87-cdd2b8457a85 => generated 1264 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:09:39.471805 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-9c531d4e-e805-41b1-bc9f-78fd82c5fe60 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:09:39.472983 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-9c531d4e-e805-41b1-bc9f-78fd82c5fe60 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: ab871db0-6362-4dd3-b29c-b513351e027b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:39.487550 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9c531d4e-e805-41b1-bc9f-78fd82c5fe60 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:39.488383 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9c531d4e-e805-41b1-bc9f-78fd82c5fe60 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:39.490611 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9c531d4e-e805-41b1-bc9f-78fd82c5fe60 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:39.492247 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9c531d4e-e805-41b1-bc9f-78fd82c5fe60 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:39.492875 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9c531d4e-e805-41b1-bc9f-78fd82c5fe60 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:39.493618 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9c531d4e-e805-41b1-bc9f-78fd82c5fe60 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:39.523808 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.objects.instance [None req-9c531d4e-e805-41b1-bc9f-78fd82c5fe60 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lazy-loading 'flavor' on Instance uuid ab871db0-6362-4dd3-b29c-b513351e027b {{(pid=121231) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 11:09:40.059711 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-9c531d4e-e805-41b1-bc9f-78fd82c5fe60 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "POST /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b/action" status: 202 len: 0 microversion: 2.20 time: 0.594380 Aug 11 11:09:40.061682 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 375/773] 10.222.0.48 () {62 vars in 1319 bytes} [Thu Aug 11 11:09:39 2022] POST /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b/action => generated 0 bytes in 597 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 11 11:09:40.070222 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-108ba977-fdfd-4680-87dc-9905d44c5492 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:40.071075 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-108ba977-fdfd-4680-87dc-9905d44c5492 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: ab871db0-6362-4dd3-b29c-b513351e027b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:40.082219 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-108ba977-fdfd-4680-87dc-9905d44c5492 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:40.082723 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-108ba977-fdfd-4680-87dc-9905d44c5492 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:40.083152 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-108ba977-fdfd-4680-87dc-9905d44c5492 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:40.085503 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-108ba977-fdfd-4680-87dc-9905d44c5492 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:40.085503 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-108ba977-fdfd-4680-87dc-9905d44c5492 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:40.085503 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-108ba977-fdfd-4680-87dc-9905d44c5492 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:40.123540 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-7da0156b-b3d3-45b3-bd99-97333a5634ca tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:40.130317 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-7da0156b-b3d3-45b3-bd99-97333a5634ca tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: d1cc9961-0393-433e-9c87-cdd2b8457a85] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:40.138155 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7da0156b-b3d3-45b3-bd99-97333a5634ca tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:40.138784 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7da0156b-b3d3-45b3-bd99-97333a5634ca tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:40.139499 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7da0156b-b3d3-45b3-bd99-97333a5634ca tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:40.140506 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7da0156b-b3d3-45b3-bd99-97333a5634ca tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:40.144018 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7da0156b-b3d3-45b3-bd99-97333a5634ca tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:40.144715 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7da0156b-b3d3-45b3-bd99-97333a5634ca tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:40.446006 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-108ba977-fdfd-4680-87dc-9905d44c5492 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:40.460601 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-108ba977-fdfd-4680-87dc-9905d44c5492 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:40.477540 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-108ba977-fdfd-4680-87dc-9905d44c5492 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:40.489873 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-108ba977-fdfd-4680-87dc-9905d44c5492 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b" status: 200 len: 1723 microversion: 2.20 time: 0.423709 Aug 11 11:09:40.491085 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 399/774] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:09:40 2022] GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b => generated 1723 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:09:40.511808 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-7da0156b-b3d3-45b3-bd99-97333a5634ca tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9dbe3b7fdd482681b6ab94c26f4e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d394882f294c6283721bcc6f8ff04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:40.521169 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-7da0156b-b3d3-45b3-bd99-97333a5634ca tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "GET /compute/v2.1/servers/d1cc9961-0393-433e-9c87-cdd2b8457a85" status: 200 len: 1264 microversion: 2.1 time: 0.403183 Aug 11 11:09:40.532514 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 376/775] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:09:40 2022] GET /compute/v2.1/servers/d1cc9961-0393-433e-9c87-cdd2b8457a85 => generated 1264 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:09:41.191943 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-cfd57acd-a2bd-4c4a-90ed-21fc82e110b4 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-834035361", "imageRef": "05993162-aafd-4f1d-b781-ec09593713e5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e9237d16-c254-4c91-b4d6-ffa10fd31ebe"}], "security_groups": [{"name": "tempest-securitygroup--2048051249"}], "key_name": "tempest-keypair-1026892144", "user_data": "}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:09:41.412772 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.network.neutron [None req-cfd57acd-a2bd-4c4a-90ed-21fc82e110b4 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] validate_networks() for [('e9237d16-c254-4c91-b4d6-ffa10fd31ebe', None, None, None, None, None)] {{(pid=121232) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 11 11:09:41.528155 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-26735f23-7b35-48de-bac2-c7c90e2cbfbe tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:41.530000 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-26735f23-7b35-48de-bac2-c7c90e2cbfbe tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: ab871db0-6362-4dd3-b29c-b513351e027b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:41.543469 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-26735f23-7b35-48de-bac2-c7c90e2cbfbe tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:41.544795 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-26735f23-7b35-48de-bac2-c7c90e2cbfbe tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:41.545389 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-26735f23-7b35-48de-bac2-c7c90e2cbfbe tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:41.546255 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-26735f23-7b35-48de-bac2-c7c90e2cbfbe tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:41.550587 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-26735f23-7b35-48de-bac2-c7c90e2cbfbe tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:41.552708 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-26735f23-7b35-48de-bac2-c7c90e2cbfbe tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:42.172440 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-26735f23-7b35-48de-bac2-c7c90e2cbfbe tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:42.182139 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-26735f23-7b35-48de-bac2-c7c90e2cbfbe tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:42.183674 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-26735f23-7b35-48de-bac2-c7c90e2cbfbe tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:42.185464 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-26735f23-7b35-48de-bac2-c7c90e2cbfbe tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b" status: 200 len: 1723 microversion: 2.20 time: 0.675379 Aug 11 11:09:42.201533 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 377/776] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:09:41 2022] GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b => generated 1723 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:09:42.208743 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-c8aedc81-23c4-4010-a97a-f953b265c13b tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:42.212634 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-c8aedc81-23c4-4010-a97a-f953b265c13b tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: d1cc9961-0393-433e-9c87-cdd2b8457a85] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:42.225605 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c8aedc81-23c4-4010-a97a-f953b265c13b tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:42.234661 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c8aedc81-23c4-4010-a97a-f953b265c13b tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:42.235123 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c8aedc81-23c4-4010-a97a-f953b265c13b tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:42.235910 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c8aedc81-23c4-4010-a97a-f953b265c13b tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:42.236385 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c8aedc81-23c4-4010-a97a-f953b265c13b tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:42.236815 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c8aedc81-23c4-4010-a97a-f953b265c13b tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:42.581587 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-c8aedc81-23c4-4010-a97a-f953b265c13b tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9dbe3b7fdd482681b6ab94c26f4e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d394882f294c6283721bcc6f8ff04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:42.596300 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-c8aedc81-23c4-4010-a97a-f953b265c13b tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "GET /compute/v2.1/servers/d1cc9961-0393-433e-9c87-cdd2b8457a85" status: 200 len: 1264 microversion: 2.1 time: 0.403053 Aug 11 11:09:42.596888 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 378/777] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:09:42 2022] GET /compute/v2.1/servers/d1cc9961-0393-433e-9c87-cdd2b8457a85 => generated 1264 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:09:42.663312 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-cfd57acd-a2bd-4c4a-90ed-21fc82e110b4 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Flavor limits 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 11 11:09:42.663920 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-cfd57acd-a2bd-4c4a-90ed-21fc82e110b4 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Image limits 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 11 11:09:42.664440 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-cfd57acd-a2bd-4c4a-90ed-21fc82e110b4 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Flavor pref 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 11 11:09:42.665199 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-cfd57acd-a2bd-4c4a-90ed-21fc82e110b4 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Image pref 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 11 11:09:42.665701 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-cfd57acd-a2bd-4c4a-90ed-21fc82e110b4 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 11 11:09:42.677632 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cfd57acd-a2bd-4c4a-90ed-21fc82e110b4 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:42.678186 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cfd57acd-a2bd-4c4a-90ed-21fc82e110b4 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:42.678669 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cfd57acd-a2bd-4c4a-90ed-21fc82e110b4 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:42.679679 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cfd57acd-a2bd-4c4a-90ed-21fc82e110b4 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:42.680277 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cfd57acd-a2bd-4c4a-90ed-21fc82e110b4 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:42.680693 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cfd57acd-a2bd-4c4a-90ed-21fc82e110b4 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:42.703456 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-cfd57acd-a2bd-4c4a-90ed-21fc82e110b4 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Getting quotas for project c56bd2a662e34a6395117027b5c28c5b. Resources: {'ram', 'cores', 'instances'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 11:09:42.708494 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-cfd57acd-a2bd-4c4a-90ed-21fc82e110b4 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Getting quotas for user 08d81bcd5a4f43ce8b4839ee15cb163b and project c56bd2a662e34a6395117027b5c28c5b. Resources: {'ram', 'cores', 'instances'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 11:09:42.728656 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-cfd57acd-a2bd-4c4a-90ed-21fc82e110b4 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Going to run 1 instances... {{(pid=121232) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 11 11:09:42.731742 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-cfd57acd-a2bd-4c4a-90ed-21fc82e110b4 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: f6bf35b3-de6a-41ae-81b7-8f45852ab5e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='05993162-aafd-4f1d-b781-ec09593713e5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121232) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 11 11:09:42.849199 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-cfd57acd-a2bd-4c4a-90ed-21fc82e110b4 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.661764 Aug 11 11:09:42.850762 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 400/778] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Aug 11 11:09:41 2022] POST /compute/v2.1/servers => generated 402 bytes in 1664 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 11 11:09:42.862380 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-1054af0d-ffed-4f97-9eec-77bd3b9cf1f2 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:42.868939 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-1054af0d-ffed-4f97-9eec-77bd3b9cf1f2 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: f6bf35b3-de6a-41ae-81b7-8f45852ab5e2] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:42.928357 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-1054af0d-ffed-4f97-9eec-77bd3b9cf1f2 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08d81bcd5a4f43ce8b4839ee15cb163b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56bd2a662e34a6395117027b5c28c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:42.942674 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-1054af0d-ffed-4f97-9eec-77bd3b9cf1f2 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/f6bf35b3-de6a-41ae-81b7-8f45852ab5e2" status: 200 len: 1241 microversion: 2.1 time: 0.079123 Aug 11 11:09:42.942674 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 379/779] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:09:42 2022] GET /compute/v2.1/servers/f6bf35b3-de6a-41ae-81b7-8f45852ab5e2 => generated 1241 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:09:43.214252 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-0bfbb26d-f12a-403d-a162-2fc15ce08cc5 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:43.214907 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-0bfbb26d-f12a-403d-a162-2fc15ce08cc5 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: ab871db0-6362-4dd3-b29c-b513351e027b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:43.225436 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0bfbb26d-f12a-403d-a162-2fc15ce08cc5 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:43.225929 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0bfbb26d-f12a-403d-a162-2fc15ce08cc5 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:43.226461 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0bfbb26d-f12a-403d-a162-2fc15ce08cc5 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:43.227154 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0bfbb26d-f12a-403d-a162-2fc15ce08cc5 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:43.227603 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0bfbb26d-f12a-403d-a162-2fc15ce08cc5 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:43.228052 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0bfbb26d-f12a-403d-a162-2fc15ce08cc5 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:43.499501 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-0bfbb26d-f12a-403d-a162-2fc15ce08cc5 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:43.513326 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-0bfbb26d-f12a-403d-a162-2fc15ce08cc5 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:43.518912 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-0bfbb26d-f12a-403d-a162-2fc15ce08cc5 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:43.520597 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-0bfbb26d-f12a-403d-a162-2fc15ce08cc5 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b" status: 200 len: 1723 microversion: 2.20 time: 0.310498 Aug 11 11:09:43.521167 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 401/780] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:09:43 2022] GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b => generated 1723 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:09:43.617195 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-8a80d30e-a1d2-4f60-90de-02088c9a1775 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:43.618415 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-8a80d30e-a1d2-4f60-90de-02088c9a1775 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: d1cc9961-0393-433e-9c87-cdd2b8457a85] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:43.626597 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8a80d30e-a1d2-4f60-90de-02088c9a1775 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:43.627373 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8a80d30e-a1d2-4f60-90de-02088c9a1775 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:43.628017 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8a80d30e-a1d2-4f60-90de-02088c9a1775 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:43.628917 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8a80d30e-a1d2-4f60-90de-02088c9a1775 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:43.629536 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8a80d30e-a1d2-4f60-90de-02088c9a1775 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:43.630121 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8a80d30e-a1d2-4f60-90de-02088c9a1775 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:43.888801 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-8a80d30e-a1d2-4f60-90de-02088c9a1775 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9dbe3b7fdd482681b6ab94c26f4e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d394882f294c6283721bcc6f8ff04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:43.899857 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-8a80d30e-a1d2-4f60-90de-02088c9a1775 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "GET /compute/v2.1/servers/d1cc9961-0393-433e-9c87-cdd2b8457a85" status: 200 len: 1264 microversion: 2.1 time: 0.286048 Aug 11 11:09:43.901086 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 380/781] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:09:43 2022] GET /compute/v2.1/servers/d1cc9961-0393-433e-9c87-cdd2b8457a85 => generated 1264 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:09:43.957731 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-74c9a01a-b89a-46a1-8583-0baea07a7a4a tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:43.958891 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-74c9a01a-b89a-46a1-8583-0baea07a7a4a tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: f6bf35b3-de6a-41ae-81b7-8f45852ab5e2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:44.070081 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-74c9a01a-b89a-46a1-8583-0baea07a7a4a tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08d81bcd5a4f43ce8b4839ee15cb163b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56bd2a662e34a6395117027b5c28c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:44.079840 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-74c9a01a-b89a-46a1-8583-0baea07a7a4a tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/f6bf35b3-de6a-41ae-81b7-8f45852ab5e2" status: 200 len: 1241 microversion: 2.1 time: 0.125926 Aug 11 11:09:44.080678 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 402/782] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:09:43 2022] GET /compute/v2.1/servers/f6bf35b3-de6a-41ae-81b7-8f45852ab5e2 => generated 1241 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:09:44.163080 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-e02ca497-b36f-4713-adfd-4dba20290fef req-8d70c469-218d-44ad-af12-b92c12dead3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1cc9961-0393-433e-9c87-cdd2b8457a85", "name": "network-vif-plugged", "status": "completed", "tag": "965e09f5-4bf9-4eeb-b7ca-f1b072b67e41"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:09:44.174912 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-e02ca497-b36f-4713-adfd-4dba20290fef req-8d70c469-218d-44ad-af12-b92c12dead3e service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:44.175710 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-e02ca497-b36f-4713-adfd-4dba20290fef req-8d70c469-218d-44ad-af12-b92c12dead3e service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:44.176271 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-e02ca497-b36f-4713-adfd-4dba20290fef req-8d70c469-218d-44ad-af12-b92c12dead3e service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:44.189162 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-e02ca497-b36f-4713-adfd-4dba20290fef req-8d70c469-218d-44ad-af12-b92c12dead3e service nova] Creating event network-vif-plugged:965e09f5-4bf9-4eeb-b7ca-f1b072b67e41 for instance d1cc9961-0393-433e-9c87-cdd2b8457a85 on hv-cinder-82002 Aug 11 11:09:44.194512 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-e02ca497-b36f-4713-adfd-4dba20290fef req-8d70c469-218d-44ad-af12-b92c12dead3e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117261 Aug 11 11:09:44.195434 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 381/783] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:09:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:09:44.268760 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-41b2b53e-d0f1-47d9-b2bd-ca1d42f80de5 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Action: 'create', calling method: .version_select at 0x7faab0b0a700>, body: {"keypair": {"name": "tempest-TestShelveInstance-515909715", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD/GevphOedxVTFk1rFFpa2hJoLAUBlHzP20TARYspggNxhn3QLAZ6wBnhqkf/z5IdWYGgxLB0jBn4n2kO57fZ2vizyR8woIxR8bVJIckSVJRNcq/bm7ZPeddkh/F+hAOg=="}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:09:44.292608 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-41b2b53e-d0f1-47d9-b2bd-ca1d42f80de5 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Getting quotas for project cea40881648b4df393fc35c07d8f68dd. Resources: {'key_pairs'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 11:09:44.296307 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-41b2b53e-d0f1-47d9-b2bd-ca1d42f80de5 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Getting quotas for user 7b2f7b56f6d94908bf00b3f21954776c and project cea40881648b4df393fc35c07d8f68dd. Resources: {'key_pairs'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 11:09:44.436822 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-41b2b53e-d0f1-47d9-b2bd-ca1d42f80de5 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.314158 Aug 11 11:09:44.439970 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 403/784] 10.222.0.48 () {60 vars in 1159 bytes} [Thu Aug 11 11:09:44 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:09:44.545974 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-8f089d78-cdcf-42f9-a49a-9a73ccee9137 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:44.546758 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-8f089d78-cdcf-42f9-a49a-9a73ccee9137 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: ab871db0-6362-4dd3-b29c-b513351e027b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:44.566243 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8f089d78-cdcf-42f9-a49a-9a73ccee9137 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:44.566757 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8f089d78-cdcf-42f9-a49a-9a73ccee9137 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:44.567201 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8f089d78-cdcf-42f9-a49a-9a73ccee9137 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:44.569962 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8f089d78-cdcf-42f9-a49a-9a73ccee9137 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:44.570477 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8f089d78-cdcf-42f9-a49a-9a73ccee9137 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:44.571158 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8f089d78-cdcf-42f9-a49a-9a73ccee9137 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:44.898530 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-8f089d78-cdcf-42f9-a49a-9a73ccee9137 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:44.907857 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-8f089d78-cdcf-42f9-a49a-9a73ccee9137 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:44.909748 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-8f089d78-cdcf-42f9-a49a-9a73ccee9137 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:44.911291 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-8f089d78-cdcf-42f9-a49a-9a73ccee9137 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b" status: 200 len: 1723 microversion: 2.20 time: 0.370675 Aug 11 11:09:44.912316 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 382/785] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:09:44 2022] GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b => generated 1723 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:09:44.931867 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-71eb8955-e547-46fd-b736-6b40b09dd205 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:44.932903 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-71eb8955-e547-46fd-b736-6b40b09dd205 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: d1cc9961-0393-433e-9c87-cdd2b8457a85] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:44.943400 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-71eb8955-e547-46fd-b736-6b40b09dd205 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:44.946212 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-71eb8955-e547-46fd-b736-6b40b09dd205 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:44.946863 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-71eb8955-e547-46fd-b736-6b40b09dd205 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:44.947796 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-71eb8955-e547-46fd-b736-6b40b09dd205 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:44.951013 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-71eb8955-e547-46fd-b736-6b40b09dd205 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:44.951430 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-71eb8955-e547-46fd-b736-6b40b09dd205 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:45.101631 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-12121ae4-b16c-478e-9517-981717e7928f tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:45.102444 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-12121ae4-b16c-478e-9517-981717e7928f tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: f6bf35b3-de6a-41ae-81b7-8f45852ab5e2] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:45.109518 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-12121ae4-b16c-478e-9517-981717e7928f tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:45.110270 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-12121ae4-b16c-478e-9517-981717e7928f tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:45.110884 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-12121ae4-b16c-478e-9517-981717e7928f tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:45.111399 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-71eb8955-e547-46fd-b736-6b40b09dd205 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9dbe3b7fdd482681b6ab94c26f4e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d394882f294c6283721bcc6f8ff04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:45.112628 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-12121ae4-b16c-478e-9517-981717e7928f tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:45.113088 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-12121ae4-b16c-478e-9517-981717e7928f tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:45.114043 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-12121ae4-b16c-478e-9517-981717e7928f tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:45.122230 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-71eb8955-e547-46fd-b736-6b40b09dd205 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "GET /compute/v2.1/servers/d1cc9961-0393-433e-9c87-cdd2b8457a85" status: 200 len: 1264 microversion: 2.1 time: 0.194183 Aug 11 11:09:45.128032 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 404/786] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:09:44 2022] GET /compute/v2.1/servers/d1cc9961-0393-433e-9c87-cdd2b8457a85 => generated 1264 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:09:45.189924 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-12121ae4-b16c-478e-9517-981717e7928f tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08d81bcd5a4f43ce8b4839ee15cb163b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56bd2a662e34a6395117027b5c28c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:45.197559 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-12121ae4-b16c-478e-9517-981717e7928f tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/f6bf35b3-de6a-41ae-81b7-8f45852ab5e2" status: 200 len: 1237 microversion: 2.1 time: 0.100309 Aug 11 11:09:45.198138 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 383/787] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:09:45 2022] GET /compute/v2.1/servers/f6bf35b3-de6a-41ae-81b7-8f45852ab5e2 => generated 1237 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:09:45.934371 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-a07b417b-4d3e-4b8a-b683-52cc131d4a17 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:45.935938 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-a07b417b-4d3e-4b8a-b683-52cc131d4a17 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: ab871db0-6362-4dd3-b29c-b513351e027b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:45.938015 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=7 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:09:45.943162 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a07b417b-4d3e-4b8a-b683-52cc131d4a17 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:45.943652 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a07b417b-4d3e-4b8a-b683-52cc131d4a17 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:45.944122 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a07b417b-4d3e-4b8a-b683-52cc131d4a17 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:45.945460 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a07b417b-4d3e-4b8a-b683-52cc131d4a17 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:45.945927 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a07b417b-4d3e-4b8a-b683-52cc131d4a17 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:45.946345 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a07b417b-4d3e-4b8a-b683-52cc131d4a17 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:46.085610 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-a07b417b-4d3e-4b8a-b683-52cc131d4a17 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:46.094432 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-a07b417b-4d3e-4b8a-b683-52cc131d4a17 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:46.104549 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-a07b417b-4d3e-4b8a-b683-52cc131d4a17 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:46.104549 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-a07b417b-4d3e-4b8a-b683-52cc131d4a17 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b" status: 200 len: 1723 microversion: 2.20 time: 0.166758 Aug 11 11:09:46.104549 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 405/788] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:09:45 2022] GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:09:46.143383 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-26768bbf-5775-44e1-9421-436e7129749f tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:46.144135 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-26768bbf-5775-44e1-9421-436e7129749f tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: d1cc9961-0393-433e-9c87-cdd2b8457a85] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:46.146529 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=1 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:09:46.151230 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-26768bbf-5775-44e1-9421-436e7129749f tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:46.151709 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-26768bbf-5775-44e1-9421-436e7129749f tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:46.152167 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-26768bbf-5775-44e1-9421-436e7129749f tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:46.152856 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-26768bbf-5775-44e1-9421-436e7129749f tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:46.153910 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-26768bbf-5775-44e1-9421-436e7129749f tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:46.154335 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-26768bbf-5775-44e1-9421-436e7129749f tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:46.226886 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-63909ea0-7611-43b0-b6c2-eff42c6d951f tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:46.227844 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-63909ea0-7611-43b0-b6c2-eff42c6d951f tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: f6bf35b3-de6a-41ae-81b7-8f45852ab5e2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:46.233829 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-63909ea0-7611-43b0-b6c2-eff42c6d951f tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:46.234471 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-63909ea0-7611-43b0-b6c2-eff42c6d951f tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:46.234912 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-63909ea0-7611-43b0-b6c2-eff42c6d951f tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:46.235638 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-63909ea0-7611-43b0-b6c2-eff42c6d951f tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:46.236111 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-63909ea0-7611-43b0-b6c2-eff42c6d951f tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:46.236539 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-63909ea0-7611-43b0-b6c2-eff42c6d951f tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:46.315404 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-26768bbf-5775-44e1-9421-436e7129749f tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9dbe3b7fdd482681b6ab94c26f4e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d394882f294c6283721bcc6f8ff04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:46.323897 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-63909ea0-7611-43b0-b6c2-eff42c6d951f tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08d81bcd5a4f43ce8b4839ee15cb163b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56bd2a662e34a6395117027b5c28c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:46.328689 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-26768bbf-5775-44e1-9421-436e7129749f tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "GET /compute/v2.1/servers/d1cc9961-0393-433e-9c87-cdd2b8457a85" status: 200 len: 1264 microversion: 2.1 time: 0.189051 Aug 11 11:09:46.331152 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 384/789] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:09:46 2022] GET /compute/v2.1/servers/d1cc9961-0393-433e-9c87-cdd2b8457a85 => generated 1264 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:09:46.335340 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-63909ea0-7611-43b0-b6c2-eff42c6d951f tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/f6bf35b3-de6a-41ae-81b7-8f45852ab5e2" status: 200 len: 1293 microversion: 2.1 time: 0.113235 Aug 11 11:09:46.336363 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 406/790] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:09:46 2022] GET /compute/v2.1/servers/f6bf35b3-de6a-41ae-81b7-8f45852ab5e2 => generated 1293 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:09:47.119099 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-ac4b43c7-4c82-4a10-a672-07005955fe69 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:47.119639 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-ac4b43c7-4c82-4a10-a672-07005955fe69 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: ab871db0-6362-4dd3-b29c-b513351e027b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:47.126582 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ac4b43c7-4c82-4a10-a672-07005955fe69 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:47.127063 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ac4b43c7-4c82-4a10-a672-07005955fe69 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:47.127498 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ac4b43c7-4c82-4a10-a672-07005955fe69 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:47.128234 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ac4b43c7-4c82-4a10-a672-07005955fe69 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:47.128688 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ac4b43c7-4c82-4a10-a672-07005955fe69 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:47.129114 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ac4b43c7-4c82-4a10-a672-07005955fe69 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:47.268074 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-ac4b43c7-4c82-4a10-a672-07005955fe69 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:47.294259 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-ac4b43c7-4c82-4a10-a672-07005955fe69 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:47.294259 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-ac4b43c7-4c82-4a10-a672-07005955fe69 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:47.294259 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-ac4b43c7-4c82-4a10-a672-07005955fe69 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b" status: 200 len: 1723 microversion: 2.20 time: 0.165198 Aug 11 11:09:47.294699 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 385/791] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:09:47 2022] GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:09:47.359345 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-6ced3056-33f0-486f-8d14-4e0926c7e1f0 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:47.360006 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-6ced3056-33f0-486f-8d14-4e0926c7e1f0 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: d1cc9961-0393-433e-9c87-cdd2b8457a85] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:47.365547 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-b2081cee-e013-46ba-9805-16bf2ba3ff74 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:47.366299 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-b2081cee-e013-46ba-9805-16bf2ba3ff74 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: f6bf35b3-de6a-41ae-81b7-8f45852ab5e2] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:47.367098 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6ced3056-33f0-486f-8d14-4e0926c7e1f0 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:47.367590 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6ced3056-33f0-486f-8d14-4e0926c7e1f0 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:47.368060 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6ced3056-33f0-486f-8d14-4e0926c7e1f0 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:47.368759 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6ced3056-33f0-486f-8d14-4e0926c7e1f0 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:47.369268 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6ced3056-33f0-486f-8d14-4e0926c7e1f0 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:47.369714 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6ced3056-33f0-486f-8d14-4e0926c7e1f0 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:47.373238 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b2081cee-e013-46ba-9805-16bf2ba3ff74 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:47.373884 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b2081cee-e013-46ba-9805-16bf2ba3ff74 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:47.374420 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b2081cee-e013-46ba-9805-16bf2ba3ff74 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:47.375459 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b2081cee-e013-46ba-9805-16bf2ba3ff74 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:47.376198 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b2081cee-e013-46ba-9805-16bf2ba3ff74 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:47.377714 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b2081cee-e013-46ba-9805-16bf2ba3ff74 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:47.658237 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-b2081cee-e013-46ba-9805-16bf2ba3ff74 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08d81bcd5a4f43ce8b4839ee15cb163b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56bd2a662e34a6395117027b5c28c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:47.669165 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-b2081cee-e013-46ba-9805-16bf2ba3ff74 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/f6bf35b3-de6a-41ae-81b7-8f45852ab5e2" status: 200 len: 1299 microversion: 2.1 time: 0.307268 Aug 11 11:09:47.669863 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 386/792] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:09:47 2022] GET /compute/v2.1/servers/f6bf35b3-de6a-41ae-81b7-8f45852ab5e2 => generated 1299 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:09:47.784980 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-6ced3056-33f0-486f-8d14-4e0926c7e1f0 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9dbe3b7fdd482681b6ab94c26f4e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d394882f294c6283721bcc6f8ff04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:47.793851 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-6ced3056-33f0-486f-8d14-4e0926c7e1f0 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "GET /compute/v2.1/servers/d1cc9961-0393-433e-9c87-cdd2b8457a85" status: 200 len: 1452 microversion: 2.1 time: 0.438758 Aug 11 11:09:47.804863 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 407/793] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:09:47 2022] GET /compute/v2.1/servers/d1cc9961-0393-433e-9c87-cdd2b8457a85 => generated 1452 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:09:47.814598 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-cb8b69bc-84aa-46c0-a598-4c5c0865caa5 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:47.815205 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-cb8b69bc-84aa-46c0-a598-4c5c0865caa5 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: d1cc9961-0393-433e-9c87-cdd2b8457a85] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:47.822874 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-cb8b69bc-84aa-46c0-a598-4c5c0865caa5 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:47.823555 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-cb8b69bc-84aa-46c0-a598-4c5c0865caa5 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:47.824192 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-cb8b69bc-84aa-46c0-a598-4c5c0865caa5 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:47.825531 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-cb8b69bc-84aa-46c0-a598-4c5c0865caa5 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:47.825983 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-cb8b69bc-84aa-46c0-a598-4c5c0865caa5 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:47.826607 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-cb8b69bc-84aa-46c0-a598-4c5c0865caa5 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:48.019247 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-cb8b69bc-84aa-46c0-a598-4c5c0865caa5 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9dbe3b7fdd482681b6ab94c26f4e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d394882f294c6283721bcc6f8ff04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:48.026900 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-cb8b69bc-84aa-46c0-a598-4c5c0865caa5 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "GET /compute/v2.1/servers/d1cc9961-0393-433e-9c87-cdd2b8457a85" status: 200 len: 1452 microversion: 2.1 time: 0.216470 Aug 11 11:09:48.027483 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 387/794] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:09:47 2022] GET /compute/v2.1/servers/d1cc9961-0393-433e-9c87-cdd2b8457a85 => generated 1452 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:09:48.306125 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-05ce3e2b-4928-4d61-87e3-d2c6e189be2c tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:48.306452 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-05ce3e2b-4928-4d61-87e3-d2c6e189be2c tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: ab871db0-6362-4dd3-b29c-b513351e027b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:48.316296 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-05ce3e2b-4928-4d61-87e3-d2c6e189be2c tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:48.317358 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-05ce3e2b-4928-4d61-87e3-d2c6e189be2c tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:48.317903 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-05ce3e2b-4928-4d61-87e3-d2c6e189be2c tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:48.318763 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-05ce3e2b-4928-4d61-87e3-d2c6e189be2c tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:48.319325 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-05ce3e2b-4928-4d61-87e3-d2c6e189be2c tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:48.322242 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-05ce3e2b-4928-4d61-87e3-d2c6e189be2c tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:48.505466 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-05ce3e2b-4928-4d61-87e3-d2c6e189be2c tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:48.513606 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-05ce3e2b-4928-4d61-87e3-d2c6e189be2c tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:48.515052 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-05ce3e2b-4928-4d61-87e3-d2c6e189be2c tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:48.516237 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-05ce3e2b-4928-4d61-87e3-d2c6e189be2c tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b" status: 200 len: 1723 microversion: 2.20 time: 0.214456 Aug 11 11:09:48.516799 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 408/795] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:09:48 2022] GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b => generated 1723 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:09:48.691706 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-664ae6be-1866-47c2-a4e5-dac8d89ab9af tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:48.692973 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-664ae6be-1866-47c2-a4e5-dac8d89ab9af tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: f6bf35b3-de6a-41ae-81b7-8f45852ab5e2] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:48.704279 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-664ae6be-1866-47c2-a4e5-dac8d89ab9af tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:48.704782 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-664ae6be-1866-47c2-a4e5-dac8d89ab9af tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:48.705283 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-664ae6be-1866-47c2-a4e5-dac8d89ab9af tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:48.706120 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-664ae6be-1866-47c2-a4e5-dac8d89ab9af tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:48.707058 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-664ae6be-1866-47c2-a4e5-dac8d89ab9af tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:48.707535 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-664ae6be-1866-47c2-a4e5-dac8d89ab9af tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:48.730213 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:09:49.040869 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-664ae6be-1866-47c2-a4e5-dac8d89ab9af tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08d81bcd5a4f43ce8b4839ee15cb163b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56bd2a662e34a6395117027b5c28c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:49.046805 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-664ae6be-1866-47c2-a4e5-dac8d89ab9af tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/f6bf35b3-de6a-41ae-81b7-8f45852ab5e2" status: 200 len: 1367 microversion: 2.1 time: 0.358929 Aug 11 11:09:49.060262 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 388/796] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:09:48 2022] GET /compute/v2.1/servers/f6bf35b3-de6a-41ae-81b7-8f45852ab5e2 => generated 1367 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:09:49.538925 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-ba9fbb11-e742-4cef-abee-293b6db52f56 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:49.544376 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-ba9fbb11-e742-4cef-abee-293b6db52f56 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: ab871db0-6362-4dd3-b29c-b513351e027b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:49.551838 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ba9fbb11-e742-4cef-abee-293b6db52f56 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:49.552621 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ba9fbb11-e742-4cef-abee-293b6db52f56 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:49.553282 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ba9fbb11-e742-4cef-abee-293b6db52f56 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:49.554179 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ba9fbb11-e742-4cef-abee-293b6db52f56 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:49.555146 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ba9fbb11-e742-4cef-abee-293b6db52f56 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:49.555974 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ba9fbb11-e742-4cef-abee-293b6db52f56 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:49.569074 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-b5c57352-b757-48e8-bb03-b3c50427abdb req-3715b25f-a61f-44d1-ae3a-5d57c90ff3dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6bf35b3-de6a-41ae-81b7-8f45852ab5e2", "tag": "7a83ec92-6913-4b9e-8486-1780dc2138d5"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:09:49.590158 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-b5c57352-b757-48e8-bb03-b3c50427abdb req-3715b25f-a61f-44d1-ae3a-5d57c90ff3dd service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:49.592329 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-b5c57352-b757-48e8-bb03-b3c50427abdb req-3715b25f-a61f-44d1-ae3a-5d57c90ff3dd service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:49.596264 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-b5c57352-b757-48e8-bb03-b3c50427abdb req-3715b25f-a61f-44d1-ae3a-5d57c90ff3dd service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:49.617269 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-b5c57352-b757-48e8-bb03-b3c50427abdb req-3715b25f-a61f-44d1-ae3a-5d57c90ff3dd service nova] Creating event network-changed:7a83ec92-6913-4b9e-8486-1780dc2138d5 for instance f6bf35b3-de6a-41ae-81b7-8f45852ab5e2 on hv-cinder-82002 Aug 11 11:09:49.635335 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-b5c57352-b757-48e8-bb03-b3c50427abdb req-3715b25f-a61f-44d1-ae3a-5d57c90ff3dd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069728 Aug 11 11:09:49.640247 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 389/797] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:09:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:09:49.786984 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-ba9fbb11-e742-4cef-abee-293b6db52f56 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:49.807580 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-ba9fbb11-e742-4cef-abee-293b6db52f56 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:49.811877 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-ba9fbb11-e742-4cef-abee-293b6db52f56 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:49.814073 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-ba9fbb11-e742-4cef-abee-293b6db52f56 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b" status: 200 len: 1723 microversion: 2.20 time: 0.279487 Aug 11 11:09:49.815414 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 409/798] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:09:49 2022] GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b => generated 1723 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:09:50.069297 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-dd752dc1-7609-4072-933c-bfe3660b2b02 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:50.071105 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-dd752dc1-7609-4072-933c-bfe3660b2b02 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: f6bf35b3-de6a-41ae-81b7-8f45852ab5e2] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:50.083990 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-dd752dc1-7609-4072-933c-bfe3660b2b02 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:50.084760 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-dd752dc1-7609-4072-933c-bfe3660b2b02 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:50.085421 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-dd752dc1-7609-4072-933c-bfe3660b2b02 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:50.086348 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-dd752dc1-7609-4072-933c-bfe3660b2b02 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:50.087043 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-dd752dc1-7609-4072-933c-bfe3660b2b02 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:50.087675 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-dd752dc1-7609-4072-933c-bfe3660b2b02 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:50.301902 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-dd752dc1-7609-4072-933c-bfe3660b2b02 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08d81bcd5a4f43ce8b4839ee15cb163b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56bd2a662e34a6395117027b5c28c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:50.315722 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-dd752dc1-7609-4072-933c-bfe3660b2b02 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/f6bf35b3-de6a-41ae-81b7-8f45852ab5e2" status: 200 len: 1367 microversion: 2.1 time: 0.246897 Aug 11 11:09:50.318335 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 390/799] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:09:50 2022] GET /compute/v2.1/servers/f6bf35b3-de6a-41ae-81b7-8f45852ab5e2 => generated 1367 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:09:50.845496 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-915054cc-36af-4f7b-8e58-e8bca900daf8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:50.846935 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-915054cc-36af-4f7b-8e58-e8bca900daf8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: ab871db0-6362-4dd3-b29c-b513351e027b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:50.863613 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-915054cc-36af-4f7b-8e58-e8bca900daf8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:50.864225 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-915054cc-36af-4f7b-8e58-e8bca900daf8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:50.864667 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-915054cc-36af-4f7b-8e58-e8bca900daf8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:50.865533 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-915054cc-36af-4f7b-8e58-e8bca900daf8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:50.866000 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-915054cc-36af-4f7b-8e58-e8bca900daf8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:50.866435 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-915054cc-36af-4f7b-8e58-e8bca900daf8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:50.883371 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-09973f1f-bef9-4e0b-baed-65902b7175ea req-e657dfd1-614e-400d-b554-fd7626404d72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1cc9961-0393-433e-9c87-cdd2b8457a85", "tag": "965e09f5-4bf9-4eeb-b7ca-f1b072b67e41"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:09:50.894654 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-09973f1f-bef9-4e0b-baed-65902b7175ea req-e657dfd1-614e-400d-b554-fd7626404d72 service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:50.895342 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-09973f1f-bef9-4e0b-baed-65902b7175ea req-e657dfd1-614e-400d-b554-fd7626404d72 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:50.901185 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-09973f1f-bef9-4e0b-baed-65902b7175ea req-e657dfd1-614e-400d-b554-fd7626404d72 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:50.911289 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-09973f1f-bef9-4e0b-baed-65902b7175ea req-e657dfd1-614e-400d-b554-fd7626404d72 service nova] Creating event network-changed:965e09f5-4bf9-4eeb-b7ca-f1b072b67e41 for instance d1cc9961-0393-433e-9c87-cdd2b8457a85 on hv-cinder-82002 Aug 11 11:09:50.917341 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-09973f1f-bef9-4e0b-baed-65902b7175ea req-e657dfd1-614e-400d-b554-fd7626404d72 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037703 Aug 11 11:09:50.922805 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 391/800] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:09:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 11:09:51.045160 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-915054cc-36af-4f7b-8e58-e8bca900daf8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:51.057609 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-915054cc-36af-4f7b-8e58-e8bca900daf8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:51.059809 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-915054cc-36af-4f7b-8e58-e8bca900daf8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:51.061087 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-915054cc-36af-4f7b-8e58-e8bca900daf8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b" status: 200 len: 1723 microversion: 2.20 time: 0.224979 Aug 11 11:09:51.061657 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 410/801] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:09:50 2022] GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b => generated 1723 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:09:51.342442 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-5a687ac7-c7ca-4f06-9b1d-c8c4376b44d5 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:51.343081 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-5a687ac7-c7ca-4f06-9b1d-c8c4376b44d5 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: f6bf35b3-de6a-41ae-81b7-8f45852ab5e2] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:51.349145 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5a687ac7-c7ca-4f06-9b1d-c8c4376b44d5 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:51.349618 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5a687ac7-c7ca-4f06-9b1d-c8c4376b44d5 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:51.350047 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5a687ac7-c7ca-4f06-9b1d-c8c4376b44d5 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:51.350820 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5a687ac7-c7ca-4f06-9b1d-c8c4376b44d5 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:51.351417 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5a687ac7-c7ca-4f06-9b1d-c8c4376b44d5 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:51.352036 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5a687ac7-c7ca-4f06-9b1d-c8c4376b44d5 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:51.499510 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-5a687ac7-c7ca-4f06-9b1d-c8c4376b44d5 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08d81bcd5a4f43ce8b4839ee15cb163b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56bd2a662e34a6395117027b5c28c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:51.509140 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-5a687ac7-c7ca-4f06-9b1d-c8c4376b44d5 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/f6bf35b3-de6a-41ae-81b7-8f45852ab5e2" status: 200 len: 1367 microversion: 2.1 time: 0.172073 Aug 11 11:09:51.509727 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 392/802] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:09:51 2022] GET /compute/v2.1/servers/f6bf35b3-de6a-41ae-81b7-8f45852ab5e2 => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:09:52.086787 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-630cc1f2-1b54-4896-8230-9d9708933081 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:52.088162 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-630cc1f2-1b54-4896-8230-9d9708933081 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: ab871db0-6362-4dd3-b29c-b513351e027b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:52.095697 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-630cc1f2-1b54-4896-8230-9d9708933081 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:52.096387 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-630cc1f2-1b54-4896-8230-9d9708933081 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:52.096828 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-630cc1f2-1b54-4896-8230-9d9708933081 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:52.097569 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-630cc1f2-1b54-4896-8230-9d9708933081 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:52.098023 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-630cc1f2-1b54-4896-8230-9d9708933081 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:52.098451 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-630cc1f2-1b54-4896-8230-9d9708933081 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:52.298851 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-630cc1f2-1b54-4896-8230-9d9708933081 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:52.323984 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-630cc1f2-1b54-4896-8230-9d9708933081 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:52.326349 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-630cc1f2-1b54-4896-8230-9d9708933081 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:52.327660 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-630cc1f2-1b54-4896-8230-9d9708933081 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b" status: 200 len: 1723 microversion: 2.20 time: 0.245721 Aug 11 11:09:52.328668 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 411/803] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:09:52 2022] GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b => generated 1723 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:09:52.530763 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-be133aa2-d771-4f57-978c-a525fbd4f6aa tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:52.531374 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-be133aa2-d771-4f57-978c-a525fbd4f6aa tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: f6bf35b3-de6a-41ae-81b7-8f45852ab5e2] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:52.538277 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-be133aa2-d771-4f57-978c-a525fbd4f6aa tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:52.538770 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-be133aa2-d771-4f57-978c-a525fbd4f6aa tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:52.539198 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-be133aa2-d771-4f57-978c-a525fbd4f6aa tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:52.540026 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-be133aa2-d771-4f57-978c-a525fbd4f6aa tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:52.540538 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-be133aa2-d771-4f57-978c-a525fbd4f6aa tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:52.540960 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-be133aa2-d771-4f57-978c-a525fbd4f6aa tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:52.781358 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-be133aa2-d771-4f57-978c-a525fbd4f6aa tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08d81bcd5a4f43ce8b4839ee15cb163b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56bd2a662e34a6395117027b5c28c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:52.792691 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-be133aa2-d771-4f57-978c-a525fbd4f6aa tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/f6bf35b3-de6a-41ae-81b7-8f45852ab5e2" status: 200 len: 1367 microversion: 2.1 time: 0.265231 Aug 11 11:09:52.793470 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 393/804] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:09:52 2022] GET /compute/v2.1/servers/f6bf35b3-de6a-41ae-81b7-8f45852ab5e2 => generated 1367 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:09:53.350958 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-ceae0ec9-f5a3-41fd-b840-148c4931d936 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:53.352236 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-ceae0ec9-f5a3-41fd-b840-148c4931d936 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: ab871db0-6362-4dd3-b29c-b513351e027b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:53.354394 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell0:SELECT=2 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:09:53.361195 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ceae0ec9-f5a3-41fd-b840-148c4931d936 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:53.362585 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ceae0ec9-f5a3-41fd-b840-148c4931d936 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:53.362585 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ceae0ec9-f5a3-41fd-b840-148c4931d936 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:53.363584 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ceae0ec9-f5a3-41fd-b840-148c4931d936 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:53.364304 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ceae0ec9-f5a3-41fd-b840-148c4931d936 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:53.364963 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ceae0ec9-f5a3-41fd-b840-148c4931d936 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:53.515929 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-ceae0ec9-f5a3-41fd-b840-148c4931d936 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:53.524626 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-ceae0ec9-f5a3-41fd-b840-148c4931d936 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:53.526163 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-ceae0ec9-f5a3-41fd-b840-148c4931d936 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:53.527333 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-ceae0ec9-f5a3-41fd-b840-148c4931d936 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b" status: 200 len: 1723 microversion: 2.20 time: 0.180560 Aug 11 11:09:53.528812 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 412/805] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:09:53 2022] GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:09:53.814443 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-8b4ecb26-f86b-466c-aaf8-661ed75065e9 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:53.815403 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-8b4ecb26-f86b-466c-aaf8-661ed75065e9 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: f6bf35b3-de6a-41ae-81b7-8f45852ab5e2] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:53.818382 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell0:SELECT=6 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:09:53.826609 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8b4ecb26-f86b-466c-aaf8-661ed75065e9 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:53.830813 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8b4ecb26-f86b-466c-aaf8-661ed75065e9 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:53.830813 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8b4ecb26-f86b-466c-aaf8-661ed75065e9 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:53.830813 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8b4ecb26-f86b-466c-aaf8-661ed75065e9 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:53.830813 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8b4ecb26-f86b-466c-aaf8-661ed75065e9 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:53.831218 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8b4ecb26-f86b-466c-aaf8-661ed75065e9 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:53.971425 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-8b4ecb26-f86b-466c-aaf8-661ed75065e9 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08d81bcd5a4f43ce8b4839ee15cb163b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56bd2a662e34a6395117027b5c28c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:53.979021 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-8b4ecb26-f86b-466c-aaf8-661ed75065e9 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/f6bf35b3-de6a-41ae-81b7-8f45852ab5e2" status: 200 len: 1367 microversion: 2.1 time: 0.169248 Aug 11 11:09:53.979866 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 394/806] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:09:53 2022] GET /compute/v2.1/servers/f6bf35b3-de6a-41ae-81b7-8f45852ab5e2 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:09:54.550435 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-b355efdc-178a-41a2-9bc7-4d48fde52a82 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:54.551069 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-b355efdc-178a-41a2-9bc7-4d48fde52a82 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: ab871db0-6362-4dd3-b29c-b513351e027b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:54.552948 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell0:SELECT=12 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:09:54.558290 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b355efdc-178a-41a2-9bc7-4d48fde52a82 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:54.567877 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b355efdc-178a-41a2-9bc7-4d48fde52a82 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:54.567877 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b355efdc-178a-41a2-9bc7-4d48fde52a82 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:54.567877 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b355efdc-178a-41a2-9bc7-4d48fde52a82 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:54.567877 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b355efdc-178a-41a2-9bc7-4d48fde52a82 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:54.568260 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b355efdc-178a-41a2-9bc7-4d48fde52a82 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:54.568260 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=100 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:09:54.692095 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-b355efdc-178a-41a2-9bc7-4d48fde52a82 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:54.700050 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-b355efdc-178a-41a2-9bc7-4d48fde52a82 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:54.701568 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-b355efdc-178a-41a2-9bc7-4d48fde52a82 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:54.702728 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-b355efdc-178a-41a2-9bc7-4d48fde52a82 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b" status: 200 len: 1723 microversion: 2.20 time: 0.156167 Aug 11 11:09:54.703297 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 413/807] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:09:54 2022] GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:09:54.999559 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-afd75bdc-0022-47bc-82b2-59b048ef8754 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:55.000257 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-afd75bdc-0022-47bc-82b2-59b048ef8754 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: f6bf35b3-de6a-41ae-81b7-8f45852ab5e2] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:55.007229 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-afd75bdc-0022-47bc-82b2-59b048ef8754 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:55.008036 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-afd75bdc-0022-47bc-82b2-59b048ef8754 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:55.008474 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-afd75bdc-0022-47bc-82b2-59b048ef8754 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:55.009182 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-afd75bdc-0022-47bc-82b2-59b048ef8754 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:55.009636 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-afd75bdc-0022-47bc-82b2-59b048ef8754 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:55.010088 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-afd75bdc-0022-47bc-82b2-59b048ef8754 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:55.143430 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-afd75bdc-0022-47bc-82b2-59b048ef8754 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08d81bcd5a4f43ce8b4839ee15cb163b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56bd2a662e34a6395117027b5c28c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:55.151427 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-afd75bdc-0022-47bc-82b2-59b048ef8754 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/f6bf35b3-de6a-41ae-81b7-8f45852ab5e2" status: 200 len: 1367 microversion: 2.1 time: 0.155649 Aug 11 11:09:55.152041 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 395/808] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:09:54 2022] GET /compute/v2.1/servers/f6bf35b3-de6a-41ae-81b7-8f45852ab5e2 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:09:55.617546 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-f91c0c3b-cd75-4cd9-bd9b-04aac94ebb98 req-50e4665c-ca14-4baa-bdd1-7cb122c095d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6bf35b3-de6a-41ae-81b7-8f45852ab5e2", "name": "network-vif-plugged", "status": "completed", "tag": "7a83ec92-6913-4b9e-8486-1780dc2138d5"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:09:55.627477 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-f91c0c3b-cd75-4cd9-bd9b-04aac94ebb98 req-50e4665c-ca14-4baa-bdd1-7cb122c095d8 service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:55.627933 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-f91c0c3b-cd75-4cd9-bd9b-04aac94ebb98 req-50e4665c-ca14-4baa-bdd1-7cb122c095d8 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:55.628365 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-f91c0c3b-cd75-4cd9-bd9b-04aac94ebb98 req-50e4665c-ca14-4baa-bdd1-7cb122c095d8 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:55.640301 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-f91c0c3b-cd75-4cd9-bd9b-04aac94ebb98 req-50e4665c-ca14-4baa-bdd1-7cb122c095d8 service nova] Creating event network-vif-plugged:7a83ec92-6913-4b9e-8486-1780dc2138d5 for instance f6bf35b3-de6a-41ae-81b7-8f45852ab5e2 on hv-cinder-82002 Aug 11 11:09:55.645436 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-f91c0c3b-cd75-4cd9-bd9b-04aac94ebb98 req-50e4665c-ca14-4baa-bdd1-7cb122c095d8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031900 Aug 11 11:09:55.656446 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 414/809] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:09:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 11:09:55.725116 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-afbccb32-35c2-4166-8dcc-eaf2f5c28a3f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:55.725825 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-afbccb32-35c2-4166-8dcc-eaf2f5c28a3f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: ab871db0-6362-4dd3-b29c-b513351e027b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:55.732133 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-afbccb32-35c2-4166-8dcc-eaf2f5c28a3f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:55.732617 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-afbccb32-35c2-4166-8dcc-eaf2f5c28a3f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:55.733047 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-afbccb32-35c2-4166-8dcc-eaf2f5c28a3f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:55.733727 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-afbccb32-35c2-4166-8dcc-eaf2f5c28a3f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:55.734169 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-afbccb32-35c2-4166-8dcc-eaf2f5c28a3f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:55.734584 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-afbccb32-35c2-4166-8dcc-eaf2f5c28a3f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:55.879940 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-afbccb32-35c2-4166-8dcc-eaf2f5c28a3f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:55.889254 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-afbccb32-35c2-4166-8dcc-eaf2f5c28a3f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:55.890768 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-afbccb32-35c2-4166-8dcc-eaf2f5c28a3f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:55.892015 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-afbccb32-35c2-4166-8dcc-eaf2f5c28a3f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b" status: 200 len: 1723 microversion: 2.20 time: 0.170775 Aug 11 11:09:55.892581 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 396/810] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:09:55 2022] GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:09:56.173923 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-6d82e1fc-acf3-419b-990c-95d5c5bea72d tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:56.174652 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-6d82e1fc-acf3-419b-990c-95d5c5bea72d tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: f6bf35b3-de6a-41ae-81b7-8f45852ab5e2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:56.180966 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6d82e1fc-acf3-419b-990c-95d5c5bea72d tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:56.181451 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6d82e1fc-acf3-419b-990c-95d5c5bea72d tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:56.181885 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6d82e1fc-acf3-419b-990c-95d5c5bea72d tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:56.182585 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6d82e1fc-acf3-419b-990c-95d5c5bea72d tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:56.183047 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6d82e1fc-acf3-419b-990c-95d5c5bea72d tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:56.184011 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6d82e1fc-acf3-419b-990c-95d5c5bea72d tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:56.336472 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-6d82e1fc-acf3-419b-990c-95d5c5bea72d tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08d81bcd5a4f43ce8b4839ee15cb163b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56bd2a662e34a6395117027b5c28c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:56.346616 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-6d82e1fc-acf3-419b-990c-95d5c5bea72d tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/f6bf35b3-de6a-41ae-81b7-8f45852ab5e2" status: 200 len: 1367 microversion: 2.1 time: 0.176682 Aug 11 11:09:56.347264 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 415/811] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:09:56 2022] GET /compute/v2.1/servers/f6bf35b3-de6a-41ae-81b7-8f45852ab5e2 => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:09:56.914558 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-856b2c49-0ce1-457e-b999-a376f835290f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:56.915108 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-856b2c49-0ce1-457e-b999-a376f835290f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: ab871db0-6362-4dd3-b29c-b513351e027b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:56.922438 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-856b2c49-0ce1-457e-b999-a376f835290f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:56.922918 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-856b2c49-0ce1-457e-b999-a376f835290f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:56.923377 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-856b2c49-0ce1-457e-b999-a376f835290f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:56.924092 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-856b2c49-0ce1-457e-b999-a376f835290f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:56.924544 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-856b2c49-0ce1-457e-b999-a376f835290f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:56.924964 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-856b2c49-0ce1-457e-b999-a376f835290f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:57.056776 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-856b2c49-0ce1-457e-b999-a376f835290f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:57.064908 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-856b2c49-0ce1-457e-b999-a376f835290f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:57.066409 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-856b2c49-0ce1-457e-b999-a376f835290f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:57.067562 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-856b2c49-0ce1-457e-b999-a376f835290f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b" status: 200 len: 1744 microversion: 2.20 time: 0.157015 Aug 11 11:09:57.068218 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 397/812] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:09:56 2022] GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b => generated 1744 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:09:57.373459 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-dbd4a73e-6e7f-4296-aae8-4281ee24d9d6 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:57.374052 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-dbd4a73e-6e7f-4296-aae8-4281ee24d9d6 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: f6bf35b3-de6a-41ae-81b7-8f45852ab5e2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:57.380645 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dbd4a73e-6e7f-4296-aae8-4281ee24d9d6 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:57.381133 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dbd4a73e-6e7f-4296-aae8-4281ee24d9d6 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:57.381563 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dbd4a73e-6e7f-4296-aae8-4281ee24d9d6 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:57.382259 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dbd4a73e-6e7f-4296-aae8-4281ee24d9d6 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:57.382716 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dbd4a73e-6e7f-4296-aae8-4281ee24d9d6 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:57.383126 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dbd4a73e-6e7f-4296-aae8-4281ee24d9d6 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:57.518939 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-dbd4a73e-6e7f-4296-aae8-4281ee24d9d6 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08d81bcd5a4f43ce8b4839ee15cb163b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56bd2a662e34a6395117027b5c28c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:57.527676 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-dbd4a73e-6e7f-4296-aae8-4281ee24d9d6 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/f6bf35b3-de6a-41ae-81b7-8f45852ab5e2" status: 200 len: 1367 microversion: 2.1 time: 0.158069 Aug 11 11:09:57.539917 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 416/813] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:09:57 2022] GET /compute/v2.1/servers/f6bf35b3-de6a-41ae-81b7-8f45852ab5e2 => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:09:58.090180 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-9db467b6-2622-4ffe-a6b7-ea70b2bc8197 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:58.090889 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-9db467b6-2622-4ffe-a6b7-ea70b2bc8197 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: ab871db0-6362-4dd3-b29c-b513351e027b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:58.097315 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9db467b6-2622-4ffe-a6b7-ea70b2bc8197 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:58.097815 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9db467b6-2622-4ffe-a6b7-ea70b2bc8197 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:58.098246 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9db467b6-2622-4ffe-a6b7-ea70b2bc8197 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:58.098937 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9db467b6-2622-4ffe-a6b7-ea70b2bc8197 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:58.099383 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9db467b6-2622-4ffe-a6b7-ea70b2bc8197 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:58.099868 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9db467b6-2622-4ffe-a6b7-ea70b2bc8197 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:58.242537 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-9db467b6-2622-4ffe-a6b7-ea70b2bc8197 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:58.251537 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-9db467b6-2622-4ffe-a6b7-ea70b2bc8197 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:58.253093 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-9db467b6-2622-4ffe-a6b7-ea70b2bc8197 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:58.254289 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-9db467b6-2622-4ffe-a6b7-ea70b2bc8197 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b" status: 200 len: 1744 microversion: 2.20 time: 0.168369 Aug 11 11:09:58.254855 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 398/814] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:09:58 2022] GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b => generated 1744 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:09:58.548391 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-2f003711-848a-4579-a224-f851b7a31327 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:58.548915 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-2f003711-848a-4579-a224-f851b7a31327 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: f6bf35b3-de6a-41ae-81b7-8f45852ab5e2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:58.555297 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2f003711-848a-4579-a224-f851b7a31327 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:58.555788 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2f003711-848a-4579-a224-f851b7a31327 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:58.556246 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2f003711-848a-4579-a224-f851b7a31327 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:58.556931 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2f003711-848a-4579-a224-f851b7a31327 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:58.557465 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2f003711-848a-4579-a224-f851b7a31327 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:58.557887 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2f003711-848a-4579-a224-f851b7a31327 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:58.698308 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-2f003711-848a-4579-a224-f851b7a31327 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08d81bcd5a4f43ce8b4839ee15cb163b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56bd2a662e34a6395117027b5c28c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:58.705782 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-2f003711-848a-4579-a224-f851b7a31327 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/f6bf35b3-de6a-41ae-81b7-8f45852ab5e2" status: 200 len: 1557 microversion: 2.1 time: 0.161399 Aug 11 11:09:58.706341 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 417/815] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:09:58 2022] GET /compute/v2.1/servers/f6bf35b3-de6a-41ae-81b7-8f45852ab5e2 => generated 1557 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:09:58.728695 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-9947ea06-4e2c-4103-9182-1f7c5cb51309 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:58.728695 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-9947ea06-4e2c-4103-9182-1f7c5cb51309 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: f6bf35b3-de6a-41ae-81b7-8f45852ab5e2] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:58.733241 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9947ea06-4e2c-4103-9182-1f7c5cb51309 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:58.733751 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9947ea06-4e2c-4103-9182-1f7c5cb51309 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:58.734199 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9947ea06-4e2c-4103-9182-1f7c5cb51309 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:58.734885 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9947ea06-4e2c-4103-9182-1f7c5cb51309 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:58.735336 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9947ea06-4e2c-4103-9182-1f7c5cb51309 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:58.735927 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9947ea06-4e2c-4103-9182-1f7c5cb51309 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:58.815448 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-9947ea06-4e2c-4103-9182-1f7c5cb51309 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/f6bf35b3-de6a-41ae-81b7-8f45852ab5e2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093604 Aug 11 11:09:58.816119 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 399/816] 10.222.0.48 () {58 vars in 1275 bytes} [Thu Aug 11 11:09:58 2022] GET /compute/v2.1/servers/f6bf35b3-de6a-41ae-81b7-8f45852ab5e2/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:09:59.277713 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-27c38128-758b-47a4-894e-d1319ceb876b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:09:59.278491 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-27c38128-758b-47a4-894e-d1319ceb876b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: ab871db0-6362-4dd3-b29c-b513351e027b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:09:59.284844 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-27c38128-758b-47a4-894e-d1319ceb876b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:59.285323 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-27c38128-758b-47a4-894e-d1319ceb876b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:59.285751 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-27c38128-758b-47a4-894e-d1319ceb876b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:59.286429 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-27c38128-758b-47a4-894e-d1319ceb876b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:59.286873 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-27c38128-758b-47a4-894e-d1319ceb876b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:59.287285 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-27c38128-758b-47a4-894e-d1319ceb876b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:59.434209 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-27c38128-758b-47a4-894e-d1319ceb876b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:59.445305 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-27c38128-758b-47a4-894e-d1319ceb876b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:59.447870 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-27c38128-758b-47a4-894e-d1319ceb876b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:09:59.450370 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-27c38128-758b-47a4-894e-d1319ceb876b tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b" status: 200 len: 1739 microversion: 2.20 time: 0.176629 Aug 11 11:09:59.482188 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 418/817] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:09:59 2022] GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b => generated 1739 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:09:59.592420 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-478ce0d9-63e8-4972-a11b-4dcbec2df813 req-6365024c-688f-48a8-b787-29d6227835ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab871db0-6362-4dd3-b29c-b513351e027b", "name": "network-vif-plugged", "status": "completed", "tag": "1f4049ad-be47-41fe-a43f-26460abf19d8"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:09:59.614552 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-478ce0d9-63e8-4972-a11b-4dcbec2df813 req-6365024c-688f-48a8-b787-29d6227835ee service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:59.615032 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-478ce0d9-63e8-4972-a11b-4dcbec2df813 req-6365024c-688f-48a8-b787-29d6227835ee service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:59.615461 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-478ce0d9-63e8-4972-a11b-4dcbec2df813 req-6365024c-688f-48a8-b787-29d6227835ee service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:59.634464 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-478ce0d9-63e8-4972-a11b-4dcbec2df813 req-6365024c-688f-48a8-b787-29d6227835ee service nova] Creating event network-vif-plugged:1f4049ad-be47-41fe-a43f-26460abf19d8 for instance ab871db0-6362-4dd3-b29c-b513351e027b on hv-cinder-82002 Aug 11 11:09:59.640814 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-478ce0d9-63e8-4972-a11b-4dcbec2df813 req-6365024c-688f-48a8-b787-29d6227835ee service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061533 Aug 11 11:09:59.642395 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 400/818] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:09:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:09:59.955259 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-22be5d16-c22b-4cec-95d9-500274f2a13e req-9d8753b9-d1f5-4173-a959-f016a17a7f36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f6bf35b3-de6a-41ae-81b7-8f45852ab5e2", "tag": "7a83ec92-6913-4b9e-8486-1780dc2138d5"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:09:59.966037 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-22be5d16-c22b-4cec-95d9-500274f2a13e req-9d8753b9-d1f5-4173-a959-f016a17a7f36 service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:09:59.966519 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-22be5d16-c22b-4cec-95d9-500274f2a13e req-9d8753b9-d1f5-4173-a959-f016a17a7f36 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:09:59.967082 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-22be5d16-c22b-4cec-95d9-500274f2a13e req-9d8753b9-d1f5-4173-a959-f016a17a7f36 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:09:59.979240 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-22be5d16-c22b-4cec-95d9-500274f2a13e req-9d8753b9-d1f5-4173-a959-f016a17a7f36 service nova] Creating event network-changed:7a83ec92-6913-4b9e-8486-1780dc2138d5 for instance f6bf35b3-de6a-41ae-81b7-8f45852ab5e2 on hv-cinder-82002 Aug 11 11:09:59.984517 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-22be5d16-c22b-4cec-95d9-500274f2a13e req-9d8753b9-d1f5-4173-a959-f016a17a7f36 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032822 Aug 11 11:09:59.985132 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 419/819] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:09:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:10:00.497569 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-c7752c5a-62cb-4eae-bb69-5e490824e133 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:00.499955 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-c7752c5a-62cb-4eae-bb69-5e490824e133 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: ab871db0-6362-4dd3-b29c-b513351e027b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:00.506832 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c7752c5a-62cb-4eae-bb69-5e490824e133 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:00.507568 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c7752c5a-62cb-4eae-bb69-5e490824e133 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:00.508208 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c7752c5a-62cb-4eae-bb69-5e490824e133 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:00.509108 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c7752c5a-62cb-4eae-bb69-5e490824e133 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:00.509559 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c7752c5a-62cb-4eae-bb69-5e490824e133 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:00.510150 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c7752c5a-62cb-4eae-bb69-5e490824e133 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:00.713178 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-c7752c5a-62cb-4eae-bb69-5e490824e133 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:00.730390 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-c7752c5a-62cb-4eae-bb69-5e490824e133 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:00.735309 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-c7752c5a-62cb-4eae-bb69-5e490824e133 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:00.737987 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-c7752c5a-62cb-4eae-bb69-5e490824e133 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b" status: 200 len: 1739 microversion: 2.20 time: 0.245246 Aug 11 11:10:00.753031 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 401/820] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:10:00 2022] GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b => generated 1739 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:10:01.768758 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-6743b1a7-3134-451a-9a16-fb3db0f41ebf tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:01.770886 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-6743b1a7-3134-451a-9a16-fb3db0f41ebf tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: ab871db0-6362-4dd3-b29c-b513351e027b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:01.779016 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6743b1a7-3134-451a-9a16-fb3db0f41ebf tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:01.779524 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6743b1a7-3134-451a-9a16-fb3db0f41ebf tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:01.780077 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6743b1a7-3134-451a-9a16-fb3db0f41ebf tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:01.780841 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6743b1a7-3134-451a-9a16-fb3db0f41ebf tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:01.781530 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6743b1a7-3134-451a-9a16-fb3db0f41ebf tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:01.782052 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6743b1a7-3134-451a-9a16-fb3db0f41ebf tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:01.942302 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-6743b1a7-3134-451a-9a16-fb3db0f41ebf tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:01.954897 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-6743b1a7-3134-451a-9a16-fb3db0f41ebf tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:01.960531 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-6743b1a7-3134-451a-9a16-fb3db0f41ebf tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:01.960531 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-6743b1a7-3134-451a-9a16-fb3db0f41ebf tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b" status: 200 len: 1739 microversion: 2.20 time: 0.194871 Aug 11 11:10:01.960531 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 420/821] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:10:01 2022] GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b => generated 1739 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:10:02.987862 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-051df1cb-4dcb-4773-8af1-cc3845bf4dd9 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:02.987862 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-051df1cb-4dcb-4773-8af1-cc3845bf4dd9 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: ab871db0-6362-4dd3-b29c-b513351e027b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:02.998224 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-051df1cb-4dcb-4773-8af1-cc3845bf4dd9 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:02.998224 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-051df1cb-4dcb-4773-8af1-cc3845bf4dd9 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:02.998224 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-051df1cb-4dcb-4773-8af1-cc3845bf4dd9 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:02.998224 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-051df1cb-4dcb-4773-8af1-cc3845bf4dd9 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:02.998596 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-051df1cb-4dcb-4773-8af1-cc3845bf4dd9 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:02.998596 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-051df1cb-4dcb-4773-8af1-cc3845bf4dd9 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:03.128343 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-051df1cb-4dcb-4773-8af1-cc3845bf4dd9 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:03.136718 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-051df1cb-4dcb-4773-8af1-cc3845bf4dd9 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:03.138222 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-051df1cb-4dcb-4773-8af1-cc3845bf4dd9 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:03.139375 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-051df1cb-4dcb-4773-8af1-cc3845bf4dd9 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b" status: 200 len: 1739 microversion: 2.20 time: 0.157216 Aug 11 11:10:03.139961 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 402/822] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:10:02 2022] GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b => generated 1739 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:10:04.162307 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-d8092beb-b6a1-42ad-a2b8-ec2565bcdd99 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:04.162915 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-d8092beb-b6a1-42ad-a2b8-ec2565bcdd99 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: ab871db0-6362-4dd3-b29c-b513351e027b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:04.170497 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d8092beb-b6a1-42ad-a2b8-ec2565bcdd99 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:04.170972 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d8092beb-b6a1-42ad-a2b8-ec2565bcdd99 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:04.171401 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d8092beb-b6a1-42ad-a2b8-ec2565bcdd99 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:04.172185 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d8092beb-b6a1-42ad-a2b8-ec2565bcdd99 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:04.172631 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d8092beb-b6a1-42ad-a2b8-ec2565bcdd99 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:04.173046 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d8092beb-b6a1-42ad-a2b8-ec2565bcdd99 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:04.316905 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d8092beb-b6a1-42ad-a2b8-ec2565bcdd99 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:04.325434 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d8092beb-b6a1-42ad-a2b8-ec2565bcdd99 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:04.326942 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d8092beb-b6a1-42ad-a2b8-ec2565bcdd99 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:04.328215 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-d8092beb-b6a1-42ad-a2b8-ec2565bcdd99 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b" status: 200 len: 1739 microversion: 2.20 time: 0.169667 Aug 11 11:10:04.328775 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 421/823] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:10:04 2022] GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b => generated 1739 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:10:05.352424 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-872bf9a6-1aec-4251-9574-15f46085973f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:05.353713 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-872bf9a6-1aec-4251-9574-15f46085973f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: ab871db0-6362-4dd3-b29c-b513351e027b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:05.360748 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-872bf9a6-1aec-4251-9574-15f46085973f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:05.361920 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-872bf9a6-1aec-4251-9574-15f46085973f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:05.362546 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-872bf9a6-1aec-4251-9574-15f46085973f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:05.363468 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-872bf9a6-1aec-4251-9574-15f46085973f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:05.364146 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-872bf9a6-1aec-4251-9574-15f46085973f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:05.369551 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-872bf9a6-1aec-4251-9574-15f46085973f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:05.536627 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-872bf9a6-1aec-4251-9574-15f46085973f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:05.545879 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-872bf9a6-1aec-4251-9574-15f46085973f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:05.547586 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-872bf9a6-1aec-4251-9574-15f46085973f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:05.549592 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-872bf9a6-1aec-4251-9574-15f46085973f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b" status: 200 len: 1739 microversion: 2.20 time: 0.201300 Aug 11 11:10:05.550451 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 403/824] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:10:05 2022] GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b => generated 1739 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:10:05.679193 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-87167c13-4350-40a7-85b8-fd7de1fde5bb tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1617580011", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-515909715", "security_groups": [{"name": "tempest-secgroup-smoke-1944166787"}], "networks": [{"uuid": "5763842e-fb7e-420f-891a-ac4dd189dfff"}], "block_device_mapping_v2": [{"uuid": "3110edd2-6ab7-4b7c-ba49-c1dd6a5ca55e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:10:05.809184 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.network.neutron [None req-87167c13-4350-40a7-85b8-fd7de1fde5bb tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] validate_networks() for [('5763842e-fb7e-420f-891a-ac4dd189dfff', None, None, None, None, None)] {{(pid=121232) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 11 11:10:06.496364 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-87167c13-4350-40a7-85b8-fd7de1fde5bb tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Flavor limits 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 11 11:10:06.497847 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-87167c13-4350-40a7-85b8-fd7de1fde5bb tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Image limits 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 11 11:10:06.498422 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-87167c13-4350-40a7-85b8-fd7de1fde5bb tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Flavor pref 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 11 11:10:06.498907 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-87167c13-4350-40a7-85b8-fd7de1fde5bb tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Image pref 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 11 11:10:06.499394 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-87167c13-4350-40a7-85b8-fd7de1fde5bb tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 11 11:10:06.510118 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-87167c13-4350-40a7-85b8-fd7de1fde5bb tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:06.510885 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-87167c13-4350-40a7-85b8-fd7de1fde5bb tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:06.511531 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-87167c13-4350-40a7-85b8-fd7de1fde5bb tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:06.512459 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-87167c13-4350-40a7-85b8-fd7de1fde5bb tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:06.512996 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-87167c13-4350-40a7-85b8-fd7de1fde5bb tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:06.513519 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-87167c13-4350-40a7-85b8-fd7de1fde5bb tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:06.535946 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-87167c13-4350-40a7-85b8-fd7de1fde5bb tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Getting quotas for project cea40881648b4df393fc35c07d8f68dd. Resources: {'ram', 'cores', 'instances'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 11:10:06.540881 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-87167c13-4350-40a7-85b8-fd7de1fde5bb tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Getting quotas for user 7b2f7b56f6d94908bf00b3f21954776c and project cea40881648b4df393fc35c07d8f68dd. Resources: {'ram', 'cores', 'instances'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 11:10:06.573859 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-77db5130-448b-465d-8201-c728a3b103e6 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:06.574476 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-77db5130-448b-465d-8201-c728a3b103e6 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: ab871db0-6362-4dd3-b29c-b513351e027b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:06.582663 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-77db5130-448b-465d-8201-c728a3b103e6 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:06.583176 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-77db5130-448b-465d-8201-c728a3b103e6 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:06.583622 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-77db5130-448b-465d-8201-c728a3b103e6 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:06.595842 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-77db5130-448b-465d-8201-c728a3b103e6 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:06.596407 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-77db5130-448b-465d-8201-c728a3b103e6 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:06.596889 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-77db5130-448b-465d-8201-c728a3b103e6 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:06.612844 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-87167c13-4350-40a7-85b8-fd7de1fde5bb tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Going to run 1 instances... {{(pid=121232) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 11 11:10:06.614922 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-87167c13-4350-40a7-85b8-fd7de1fde5bb tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] [instance: 9c9f7edb-2175-4575-ac11-781015e25a57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3110edd2-6ab7-4b7c-ba49-c1dd6a5ca55e',volume_size=None,volume_type=None)] {{(pid=121232) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 11 11:10:06.747695 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-77db5130-448b-465d-8201-c728a3b103e6 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:06.756044 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-77db5130-448b-465d-8201-c728a3b103e6 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:06.757719 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-77db5130-448b-465d-8201-c728a3b103e6 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:06.758832 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-77db5130-448b-465d-8201-c728a3b103e6 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b" status: 200 len: 1739 microversion: 2.20 time: 0.189997 Aug 11 11:10:06.759451 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 404/825] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:10:06 2022] GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b => generated 1739 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:10:06.763949 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-ed2fd543-06a1-496e-a31f-44f93541935d tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:06.764430 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-ed2fd543-06a1-496e-a31f-44f93541935d tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 703afaf7-e5a4-486b-a781-4bd2e3b06981] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:06.770525 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ed2fd543-06a1-496e-a31f-44f93541935d tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:06.771076 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ed2fd543-06a1-496e-a31f-44f93541935d tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:06.771594 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ed2fd543-06a1-496e-a31f-44f93541935d tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:06.772543 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ed2fd543-06a1-496e-a31f-44f93541935d tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:06.773072 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ed2fd543-06a1-496e-a31f-44f93541935d tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:06.773563 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ed2fd543-06a1-496e-a31f-44f93541935d tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:06.797815 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-ed2fd543-06a1-496e-a31f-44f93541935d tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/703afaf7-e5a4-486b-a781-4bd2e3b06981/ips" status: 200 len: 147 microversion: 2.1 time: 0.037349 Aug 11 11:10:06.798404 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 405/826] 10.222.0.48 () {58 vars in 1248 bytes} [Thu Aug 11 11:10:06 2022] GET /compute/v2.1/servers/703afaf7-e5a4-486b-a781-4bd2e3b06981/ips => generated 147 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:10:07.555225 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-87167c13-4350-40a7-85b8-fd7de1fde5bb tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.881553 Aug 11 11:10:07.563504 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 422/827] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Aug 11 11:10:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 1890 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 11 11:10:07.568389 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-b73a84d8-faba-4db5-b604-84f743244208 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:07.569003 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-b73a84d8-faba-4db5-b604-84f743244208 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] [instance: 9c9f7edb-2175-4575-ac11-781015e25a57] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:07.633352 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-b73a84d8-faba-4db5-b604-84f743244208 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b2f7b56f6d94908bf00b3f21954776c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea40881648b4df393fc35c07d8f68dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:07.640805 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-b73a84d8-faba-4db5-b604-84f743244208 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] 10.222.0.48 "GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57" status: 200 len: 1088 microversion: 2.1 time: 0.076219 Aug 11 11:10:07.645157 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 406/828] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:10:07 2022] GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57 => generated 1088 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:10:07.783487 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-1de0c2b7-4e54-47b2-b75e-abfd7e6c0671 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:07.784330 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-1de0c2b7-4e54-47b2-b75e-abfd7e6c0671 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: ab871db0-6362-4dd3-b29c-b513351e027b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:07.796654 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1de0c2b7-4e54-47b2-b75e-abfd7e6c0671 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:07.798702 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1de0c2b7-4e54-47b2-b75e-abfd7e6c0671 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:07.799980 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1de0c2b7-4e54-47b2-b75e-abfd7e6c0671 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:07.800922 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1de0c2b7-4e54-47b2-b75e-abfd7e6c0671 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:07.801387 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1de0c2b7-4e54-47b2-b75e-abfd7e6c0671 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:07.801812 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1de0c2b7-4e54-47b2-b75e-abfd7e6c0671 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:07.974571 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-1de0c2b7-4e54-47b2-b75e-abfd7e6c0671 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:07.986684 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-1de0c2b7-4e54-47b2-b75e-abfd7e6c0671 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:07.988283 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-1de0c2b7-4e54-47b2-b75e-abfd7e6c0671 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:07.989675 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-1de0c2b7-4e54-47b2-b75e-abfd7e6c0671 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b" status: 200 len: 1739 microversion: 2.20 time: 0.211334 Aug 11 11:10:07.990661 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 423/829] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:10:07 2022] GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b => generated 1739 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:10:08.661386 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-57ef9dd4-754b-4645-8333-00d1606b24fc tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:08.662165 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-57ef9dd4-754b-4645-8333-00d1606b24fc tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] [instance: 9c9f7edb-2175-4575-ac11-781015e25a57] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:08.724896 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-57ef9dd4-754b-4645-8333-00d1606b24fc tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b2f7b56f6d94908bf00b3f21954776c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea40881648b4df393fc35c07d8f68dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:08.732986 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-57ef9dd4-754b-4645-8333-00d1606b24fc tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] 10.222.0.48 "GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57" status: 200 len: 1088 microversion: 2.1 time: 0.074995 Aug 11 11:10:08.733939 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 407/830] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:10:08 2022] GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57 => generated 1088 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:10:08.801360 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-daefdbd0-78bc-49dc-8e2a-cbb28085700b tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "29a5da93-b076-4286-b9a2-11460a3547dd"}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:10:08.804444 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-daefdbd0-78bc-49dc-8e2a-cbb28085700b tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 703afaf7-e5a4-486b-a781-4bd2e3b06981] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:08.812492 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-daefdbd0-78bc-49dc-8e2a-cbb28085700b tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:08.813108 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-daefdbd0-78bc-49dc-8e2a-cbb28085700b tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:08.813548 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-daefdbd0-78bc-49dc-8e2a-cbb28085700b tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:08.814258 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-daefdbd0-78bc-49dc-8e2a-cbb28085700b tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:08.814706 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-daefdbd0-78bc-49dc-8e2a-cbb28085700b tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:08.817636 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-daefdbd0-78bc-49dc-8e2a-cbb28085700b tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:09.014349 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-fe010cda-28e4-4367-9a41-c246986050ca tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:09.015299 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-fe010cda-28e4-4367-9a41-c246986050ca tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: ab871db0-6362-4dd3-b29c-b513351e027b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:09.023456 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fe010cda-28e4-4367-9a41-c246986050ca tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:09.024413 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fe010cda-28e4-4367-9a41-c246986050ca tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:09.025194 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fe010cda-28e4-4367-9a41-c246986050ca tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:09.028134 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fe010cda-28e4-4367-9a41-c246986050ca tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:09.029211 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fe010cda-28e4-4367-9a41-c246986050ca tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:09.029809 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fe010cda-28e4-4367-9a41-c246986050ca tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:09.197401 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-fe010cda-28e4-4367-9a41-c246986050ca tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:09.206730 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-fe010cda-28e4-4367-9a41-c246986050ca tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:09.208275 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-fe010cda-28e4-4367-9a41-c246986050ca tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:09.209919 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-fe010cda-28e4-4367-9a41-c246986050ca tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b" status: 200 len: 1739 microversion: 2.20 time: 0.200211 Aug 11 11:10:09.226533 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 408/831] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:10:09 2022] GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b => generated 1739 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 11:10:09.712005 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-daefdbd0-78bc-49dc-8e2a-cbb28085700b tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "POST /compute/v2.1/servers/703afaf7-e5a4-486b-a781-4bd2e3b06981/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.914805 Aug 11 11:10:09.714117 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 424/832] 10.222.0.48 () {60 vars in 1323 bytes} [Thu Aug 11 11:10:08 2022] POST /compute/v2.1/servers/703afaf7-e5a4-486b-a781-4bd2e3b06981/os-volume_attachments => generated 194 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:10:09.754578 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-00f36115-ca63-4734-a48d-b4430cf3ba98 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:09.755460 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-00f36115-ca63-4734-a48d-b4430cf3ba98 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] [instance: 9c9f7edb-2175-4575-ac11-781015e25a57] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:09.761862 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-00f36115-ca63-4734-a48d-b4430cf3ba98 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:09.762380 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-00f36115-ca63-4734-a48d-b4430cf3ba98 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:09.762847 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-00f36115-ca63-4734-a48d-b4430cf3ba98 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:09.763521 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-00f36115-ca63-4734-a48d-b4430cf3ba98 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:09.764078 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-00f36115-ca63-4734-a48d-b4430cf3ba98 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:09.764510 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-00f36115-ca63-4734-a48d-b4430cf3ba98 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:09.810651 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell1:SELECT=100 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:10:09.879077 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-00f36115-ca63-4734-a48d-b4430cf3ba98 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b2f7b56f6d94908bf00b3f21954776c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea40881648b4df393fc35c07d8f68dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:09.888868 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-00f36115-ca63-4734-a48d-b4430cf3ba98 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] 10.222.0.48 "GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57" status: 200 len: 1186 microversion: 2.1 time: 0.138153 Aug 11 11:10:09.889662 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 409/833] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:10:09 2022] GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57 => generated 1186 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:10:10.234133 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-064c73b9-5b78-4fbb-a8e8-2fe7a934411f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:10.234875 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-064c73b9-5b78-4fbb-a8e8-2fe7a934411f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: ab871db0-6362-4dd3-b29c-b513351e027b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:10.241343 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-064c73b9-5b78-4fbb-a8e8-2fe7a934411f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:10.241851 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-064c73b9-5b78-4fbb-a8e8-2fe7a934411f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:10.242336 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-064c73b9-5b78-4fbb-a8e8-2fe7a934411f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:10.243125 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-064c73b9-5b78-4fbb-a8e8-2fe7a934411f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:10.243572 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-064c73b9-5b78-4fbb-a8e8-2fe7a934411f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:10.244056 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-064c73b9-5b78-4fbb-a8e8-2fe7a934411f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:10.389067 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-064c73b9-5b78-4fbb-a8e8-2fe7a934411f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:10.397316 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-064c73b9-5b78-4fbb-a8e8-2fe7a934411f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:10.399257 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-064c73b9-5b78-4fbb-a8e8-2fe7a934411f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:10.400481 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-064c73b9-5b78-4fbb-a8e8-2fe7a934411f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b" status: 200 len: 1739 microversion: 2.20 time: 0.171089 Aug 11 11:10:10.401637 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 425/834] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:10:10 2022] GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b => generated 1739 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:10:10.911031 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-0d81424d-6b1a-46a6-a34a-fe85bd73b73e tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:10.912449 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-0d81424d-6b1a-46a6-a34a-fe85bd73b73e tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] [instance: 9c9f7edb-2175-4575-ac11-781015e25a57] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:10.921902 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0d81424d-6b1a-46a6-a34a-fe85bd73b73e tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:10.922754 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0d81424d-6b1a-46a6-a34a-fe85bd73b73e tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:10.923596 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0d81424d-6b1a-46a6-a34a-fe85bd73b73e tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:10.924526 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0d81424d-6b1a-46a6-a34a-fe85bd73b73e tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:10.925201 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0d81424d-6b1a-46a6-a34a-fe85bd73b73e tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:10.925902 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0d81424d-6b1a-46a6-a34a-fe85bd73b73e tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:11.005443 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-0d81424d-6b1a-46a6-a34a-fe85bd73b73e tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b2f7b56f6d94908bf00b3f21954776c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea40881648b4df393fc35c07d8f68dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:11.017456 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-0d81424d-6b1a-46a6-a34a-fe85bd73b73e tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] 10.222.0.48 "GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57" status: 200 len: 1194 microversion: 2.1 time: 0.110016 Aug 11 11:10:11.018850 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 410/835] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:10:10 2022] GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57 => generated 1194 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:10:11.424548 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-704c4475-ca03-40bd-af76-d9f304d69a38 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:11.425268 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-704c4475-ca03-40bd-af76-d9f304d69a38 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: ab871db0-6362-4dd3-b29c-b513351e027b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:11.431865 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-704c4475-ca03-40bd-af76-d9f304d69a38 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:11.432538 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-704c4475-ca03-40bd-af76-d9f304d69a38 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:11.432990 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-704c4475-ca03-40bd-af76-d9f304d69a38 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:11.433658 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-704c4475-ca03-40bd-af76-d9f304d69a38 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:11.434106 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-704c4475-ca03-40bd-af76-d9f304d69a38 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:11.434526 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-704c4475-ca03-40bd-af76-d9f304d69a38 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:11.575710 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-704c4475-ca03-40bd-af76-d9f304d69a38 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:11.583577 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-704c4475-ca03-40bd-af76-d9f304d69a38 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:11.585130 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-704c4475-ca03-40bd-af76-d9f304d69a38 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:11.586488 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-704c4475-ca03-40bd-af76-d9f304d69a38 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b" status: 200 len: 1739 microversion: 2.20 time: 0.166010 Aug 11 11:10:11.587240 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 426/836] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:10:11 2022] GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b => generated 1739 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:10:12.043352 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-fea8beb2-9dfc-4a04-b8c0-ddc57fdbab12 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:12.044119 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-fea8beb2-9dfc-4a04-b8c0-ddc57fdbab12 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] [instance: 9c9f7edb-2175-4575-ac11-781015e25a57] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:12.050611 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fea8beb2-9dfc-4a04-b8c0-ddc57fdbab12 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:12.051175 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fea8beb2-9dfc-4a04-b8c0-ddc57fdbab12 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:12.051618 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fea8beb2-9dfc-4a04-b8c0-ddc57fdbab12 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:12.052343 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fea8beb2-9dfc-4a04-b8c0-ddc57fdbab12 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:12.052800 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fea8beb2-9dfc-4a04-b8c0-ddc57fdbab12 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:12.053228 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fea8beb2-9dfc-4a04-b8c0-ddc57fdbab12 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:12.229143 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-fea8beb2-9dfc-4a04-b8c0-ddc57fdbab12 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b2f7b56f6d94908bf00b3f21954776c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea40881648b4df393fc35c07d8f68dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:12.236901 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-fea8beb2-9dfc-4a04-b8c0-ddc57fdbab12 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] 10.222.0.48 "GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57" status: 200 len: 1272 microversion: 2.1 time: 0.198261 Aug 11 11:10:12.237463 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 411/837] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:10:12 2022] GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57 => generated 1272 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:10:12.530131 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-e82a5e8b-ca32-475d-a630-4ae11a916ba0 req-2cb2f07a-f7a5-4c8f-86c0-b5aec6df2898 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c9f7edb-2175-4575-ac11-781015e25a57", "tag": "c6b87a06-7611-406e-8113-f1a3bada6e72"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:10:12.540834 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-e82a5e8b-ca32-475d-a630-4ae11a916ba0 req-2cb2f07a-f7a5-4c8f-86c0-b5aec6df2898 service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:12.541954 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-e82a5e8b-ca32-475d-a630-4ae11a916ba0 req-2cb2f07a-f7a5-4c8f-86c0-b5aec6df2898 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:12.542386 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-e82a5e8b-ca32-475d-a630-4ae11a916ba0 req-2cb2f07a-f7a5-4c8f-86c0-b5aec6df2898 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:12.553740 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-e82a5e8b-ca32-475d-a630-4ae11a916ba0 req-2cb2f07a-f7a5-4c8f-86c0-b5aec6df2898 service nova] Creating event network-changed:c6b87a06-7611-406e-8113-f1a3bada6e72 for instance 9c9f7edb-2175-4575-ac11-781015e25a57 on hv-cinder-82002 Aug 11 11:10:12.558619 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-e82a5e8b-ca32-475d-a630-4ae11a916ba0 req-2cb2f07a-f7a5-4c8f-86c0-b5aec6df2898 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032692 Aug 11 11:10:12.559228 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 427/838] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:10:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:10:12.610675 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-c798e48a-80fa-4f46-9e24-1222fc3b61da tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:12.611373 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-c798e48a-80fa-4f46-9e24-1222fc3b61da tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: ab871db0-6362-4dd3-b29c-b513351e027b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:12.617653 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c798e48a-80fa-4f46-9e24-1222fc3b61da tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:12.618134 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c798e48a-80fa-4f46-9e24-1222fc3b61da tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:12.618563 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c798e48a-80fa-4f46-9e24-1222fc3b61da tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:12.619277 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c798e48a-80fa-4f46-9e24-1222fc3b61da tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:12.619724 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c798e48a-80fa-4f46-9e24-1222fc3b61da tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:12.620241 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c798e48a-80fa-4f46-9e24-1222fc3b61da tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:12.834220 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-c798e48a-80fa-4f46-9e24-1222fc3b61da tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:12.843089 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-c798e48a-80fa-4f46-9e24-1222fc3b61da tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:12.844717 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-c798e48a-80fa-4f46-9e24-1222fc3b61da tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:12.845991 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-c798e48a-80fa-4f46-9e24-1222fc3b61da tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b" status: 200 len: 1721 microversion: 2.20 time: 0.239479 Aug 11 11:10:12.846823 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 412/839] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:10:12 2022] GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b => generated 1721 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:10:13.259184 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-62280ef4-2ad8-4388-9191-3ecc0788bd5f tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:13.261962 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-62280ef4-2ad8-4388-9191-3ecc0788bd5f tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] [instance: 9c9f7edb-2175-4575-ac11-781015e25a57] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:13.268493 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-62280ef4-2ad8-4388-9191-3ecc0788bd5f tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:13.269089 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-62280ef4-2ad8-4388-9191-3ecc0788bd5f tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:13.269628 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-62280ef4-2ad8-4388-9191-3ecc0788bd5f tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:13.270524 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-62280ef4-2ad8-4388-9191-3ecc0788bd5f tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:13.271037 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-62280ef4-2ad8-4388-9191-3ecc0788bd5f tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:13.271706 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-62280ef4-2ad8-4388-9191-3ecc0788bd5f tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:13.405434 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-62280ef4-2ad8-4388-9191-3ecc0788bd5f tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b2f7b56f6d94908bf00b3f21954776c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea40881648b4df393fc35c07d8f68dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:13.412987 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-62280ef4-2ad8-4388-9191-3ecc0788bd5f tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] 10.222.0.48 "GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57" status: 200 len: 1272 microversion: 2.1 time: 0.158345 Aug 11 11:10:13.413553 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 428/840] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:10:13 2022] GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57 => generated 1272 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:10:13.870715 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-aea54678-c67a-4d29-83b1-e1aee11271e2 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:13.871285 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-aea54678-c67a-4d29-83b1-e1aee11271e2 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: ab871db0-6362-4dd3-b29c-b513351e027b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:13.877717 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-aea54678-c67a-4d29-83b1-e1aee11271e2 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:13.878194 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-aea54678-c67a-4d29-83b1-e1aee11271e2 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:13.878628 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-aea54678-c67a-4d29-83b1-e1aee11271e2 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:13.879307 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-aea54678-c67a-4d29-83b1-e1aee11271e2 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:13.879781 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-aea54678-c67a-4d29-83b1-e1aee11271e2 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:13.880200 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-aea54678-c67a-4d29-83b1-e1aee11271e2 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:14.005680 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-aea54678-c67a-4d29-83b1-e1aee11271e2 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:14.013916 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-aea54678-c67a-4d29-83b1-e1aee11271e2 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:14.015414 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-aea54678-c67a-4d29-83b1-e1aee11271e2 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:14.016598 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-aea54678-c67a-4d29-83b1-e1aee11271e2 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b" status: 200 len: 1721 microversion: 2.20 time: 0.150427 Aug 11 11:10:14.017154 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 413/841] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:10:13 2022] GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:10:14.435088 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-afca2ec9-ae33-4156-b93b-57e0205e67bf tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:14.435782 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-afca2ec9-ae33-4156-b93b-57e0205e67bf tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] [instance: 9c9f7edb-2175-4575-ac11-781015e25a57] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:14.442352 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-afca2ec9-ae33-4156-b93b-57e0205e67bf tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:14.442831 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-afca2ec9-ae33-4156-b93b-57e0205e67bf tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:14.444289 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-afca2ec9-ae33-4156-b93b-57e0205e67bf tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:14.444990 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-afca2ec9-ae33-4156-b93b-57e0205e67bf tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:14.445449 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-afca2ec9-ae33-4156-b93b-57e0205e67bf tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:14.446662 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-afca2ec9-ae33-4156-b93b-57e0205e67bf tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:14.581045 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-afca2ec9-ae33-4156-b93b-57e0205e67bf tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b2f7b56f6d94908bf00b3f21954776c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea40881648b4df393fc35c07d8f68dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:14.589153 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-afca2ec9-ae33-4156-b93b-57e0205e67bf tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] 10.222.0.48 "GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57" status: 200 len: 1272 microversion: 2.1 time: 0.158571 Aug 11 11:10:14.589717 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 429/842] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:10:14 2022] GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57 => generated 1272 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:10:15.042099 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-6491b889-7363-459e-adf5-0c1aac906d9e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:15.042649 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-6491b889-7363-459e-adf5-0c1aac906d9e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: ab871db0-6362-4dd3-b29c-b513351e027b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:15.049378 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6491b889-7363-459e-adf5-0c1aac906d9e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:15.049860 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6491b889-7363-459e-adf5-0c1aac906d9e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:15.050309 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6491b889-7363-459e-adf5-0c1aac906d9e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:15.050988 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6491b889-7363-459e-adf5-0c1aac906d9e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:15.051436 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6491b889-7363-459e-adf5-0c1aac906d9e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:15.051898 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6491b889-7363-459e-adf5-0c1aac906d9e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:15.187325 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-6491b889-7363-459e-adf5-0c1aac906d9e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:15.195665 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-6491b889-7363-459e-adf5-0c1aac906d9e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:15.197248 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-6491b889-7363-459e-adf5-0c1aac906d9e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:15.198395 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-6491b889-7363-459e-adf5-0c1aac906d9e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b" status: 200 len: 1721 microversion: 2.20 time: 0.161369 Aug 11 11:10:15.198994 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 414/843] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:10:15 2022] GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:10:15.600015 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-0049023e-8d7d-4a3a-988c-c52016405d0e req-da97e8f7-548d-4054-92c4-f7564c6302a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab871db0-6362-4dd3-b29c-b513351e027b", "name": "network-vif-unplugged", "status": "completed", "tag": "1f4049ad-be47-41fe-a43f-26460abf19d8"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:10:15.611753 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-8d4985f1-a027-4aa2-870d-dfabd64240f4 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:15.612656 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-0049023e-8d7d-4a3a-988c-c52016405d0e req-da97e8f7-548d-4054-92c4-f7564c6302a6 service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:15.612784 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-8d4985f1-a027-4aa2-870d-dfabd64240f4 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] [instance: 9c9f7edb-2175-4575-ac11-781015e25a57] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:15.612887 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-0049023e-8d7d-4a3a-988c-c52016405d0e req-da97e8f7-548d-4054-92c4-f7564c6302a6 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:15.612887 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-0049023e-8d7d-4a3a-988c-c52016405d0e req-da97e8f7-548d-4054-92c4-f7564c6302a6 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:15.616747 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8d4985f1-a027-4aa2-870d-dfabd64240f4 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:15.617221 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8d4985f1-a027-4aa2-870d-dfabd64240f4 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:15.617654 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8d4985f1-a027-4aa2-870d-dfabd64240f4 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:15.618329 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8d4985f1-a027-4aa2-870d-dfabd64240f4 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:15.618771 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8d4985f1-a027-4aa2-870d-dfabd64240f4 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:15.619197 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8d4985f1-a027-4aa2-870d-dfabd64240f4 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:15.624230 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-0049023e-8d7d-4a3a-988c-c52016405d0e req-da97e8f7-548d-4054-92c4-f7564c6302a6 service nova] Creating event network-vif-unplugged:1f4049ad-be47-41fe-a43f-26460abf19d8 for instance ab871db0-6362-4dd3-b29c-b513351e027b on hv-cinder-82002 Aug 11 11:10:15.629093 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-0049023e-8d7d-4a3a-988c-c52016405d0e req-da97e8f7-548d-4054-92c4-f7564c6302a6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032812 Aug 11 11:10:15.630054 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 430/844] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:10:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:10:15.755379 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-8d4985f1-a027-4aa2-870d-dfabd64240f4 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b2f7b56f6d94908bf00b3f21954776c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea40881648b4df393fc35c07d8f68dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:15.762954 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-8d4985f1-a027-4aa2-870d-dfabd64240f4 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] 10.222.0.48 "GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57" status: 200 len: 1272 microversion: 2.1 time: 0.156382 Aug 11 11:10:15.763526 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 415/845] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:10:15 2022] GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57 => generated 1272 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:10:16.221330 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-c927938b-e366-4253-998f-d470466be86f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:16.222337 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-c927938b-e366-4253-998f-d470466be86f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: ab871db0-6362-4dd3-b29c-b513351e027b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:16.224479 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:10:16.229597 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c927938b-e366-4253-998f-d470466be86f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:16.230122 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c927938b-e366-4253-998f-d470466be86f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:16.230591 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c927938b-e366-4253-998f-d470466be86f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:16.231287 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c927938b-e366-4253-998f-d470466be86f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:16.231736 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c927938b-e366-4253-998f-d470466be86f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:16.232182 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c927938b-e366-4253-998f-d470466be86f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:16.362799 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-c927938b-e366-4253-998f-d470466be86f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:16.366227 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:10:16.371598 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-c927938b-e366-4253-998f-d470466be86f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:16.373137 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-c927938b-e366-4253-998f-d470466be86f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:16.374288 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-c927938b-e366-4253-998f-d470466be86f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b" status: 200 len: 1664 microversion: 2.20 time: 0.157248 Aug 11 11:10:16.374843 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 431/846] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:10:16 2022] GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b => generated 1664 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:10:16.401326 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-4cd65a60-597d-4904-bb33-84f92b19d71c tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d1574697-5a1d-4212-9bd1-3ad279221594"}} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:10:16.403786 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-4cd65a60-597d-4904-bb33-84f92b19d71c tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: ab871db0-6362-4dd3-b29c-b513351e027b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:16.410189 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4cd65a60-597d-4904-bb33-84f92b19d71c tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:16.410675 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4cd65a60-597d-4904-bb33-84f92b19d71c tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:16.411111 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4cd65a60-597d-4904-bb33-84f92b19d71c tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:16.411821 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4cd65a60-597d-4904-bb33-84f92b19d71c tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:16.412278 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4cd65a60-597d-4904-bb33-84f92b19d71c tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:16.412710 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4cd65a60-597d-4904-bb33-84f92b19d71c tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:16.784545 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-8e226357-654c-4b5e-ac54-100839478f46 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:16.785156 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-8e226357-654c-4b5e-ac54-100839478f46 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] [instance: 9c9f7edb-2175-4575-ac11-781015e25a57] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:16.787219 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell0:SELECT=2 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:10:16.788018 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell0:SELECT=6 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:10:16.794971 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8e226357-654c-4b5e-ac54-100839478f46 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:16.795464 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8e226357-654c-4b5e-ac54-100839478f46 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:16.795943 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8e226357-654c-4b5e-ac54-100839478f46 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:16.796630 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8e226357-654c-4b5e-ac54-100839478f46 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:16.797084 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8e226357-654c-4b5e-ac54-100839478f46 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:16.797505 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-8e226357-654c-4b5e-ac54-100839478f46 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:16.935222 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-8e226357-654c-4b5e-ac54-100839478f46 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b2f7b56f6d94908bf00b3f21954776c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea40881648b4df393fc35c07d8f68dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:16.942759 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-8e226357-654c-4b5e-ac54-100839478f46 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] 10.222.0.48 "GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57" status: 200 len: 1272 microversion: 2.1 time: 0.162469 Aug 11 11:10:16.943329 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 432/847] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:10:16 2022] GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57 => generated 1272 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:10:17.488807 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-4cd65a60-597d-4904-bb33-84f92b19d71c tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "POST /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.091565 Aug 11 11:10:17.489437 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 416/848] 10.222.0.48 () {62 vars in 1364 bytes} [Thu Aug 11 11:10:16 2022] POST /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b/os-volume_attachments => generated 188 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 11:10:17.611160 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-9325f999-9f99-4d48-8fa2-04532ce88c1a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:17.611649 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-9325f999-9f99-4d48-8fa2-04532ce88c1a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: ab871db0-6362-4dd3-b29c-b513351e027b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:17.619128 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9325f999-9f99-4d48-8fa2-04532ce88c1a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:17.619610 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9325f999-9f99-4d48-8fa2-04532ce88c1a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:17.620067 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9325f999-9f99-4d48-8fa2-04532ce88c1a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:17.620818 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9325f999-9f99-4d48-8fa2-04532ce88c1a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:17.621259 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9325f999-9f99-4d48-8fa2-04532ce88c1a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:17.622027 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9325f999-9f99-4d48-8fa2-04532ce88c1a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:17.963636 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-69679316-b798-4d7c-a7cf-05e384b44950 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:17.964199 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-69679316-b798-4d7c-a7cf-05e384b44950 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] [instance: 9c9f7edb-2175-4575-ac11-781015e25a57] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:17.966704 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_api:SELECT=70 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:10:17.971411 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-69679316-b798-4d7c-a7cf-05e384b44950 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:17.971935 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-69679316-b798-4d7c-a7cf-05e384b44950 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:17.972381 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-69679316-b798-4d7c-a7cf-05e384b44950 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:17.973068 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-69679316-b798-4d7c-a7cf-05e384b44950 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:17.973522 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-69679316-b798-4d7c-a7cf-05e384b44950 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:17.973947 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-69679316-b798-4d7c-a7cf-05e384b44950 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:18.121745 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-69679316-b798-4d7c-a7cf-05e384b44950 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b2f7b56f6d94908bf00b3f21954776c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea40881648b4df393fc35c07d8f68dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:18.129213 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-69679316-b798-4d7c-a7cf-05e384b44950 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] 10.222.0.48 "GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57" status: 200 len: 1272 microversion: 2.1 time: 0.169608 Aug 11 11:10:18.129902 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 417/849] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:10:17 2022] GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57 => generated 1272 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:10:18.276820 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-9325f999-9f99-4d48-8fa2-04532ce88c1a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "DELETE /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b/os-volume_attachments/d1574697-5a1d-4212-9bd1-3ad279221594" status: 202 len: 0 microversion: 2.20 time: 0.670514 Aug 11 11:10:18.277566 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 433/850] 10.222.0.48 () {60 vars in 1457 bytes} [Thu Aug 11 11:10:17 2022] DELETE /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b/os-volume_attachments/d1574697-5a1d-4212-9bd1-3ad279221594 => generated 0 bytes in 672 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 11 11:10:18.339629 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-fbd4578a-5445-4ce1-a9dc-c296f2142b76 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:10:18.340249 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-fbd4578a-5445-4ce1-a9dc-c296f2142b76 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: ab871db0-6362-4dd3-b29c-b513351e027b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:18.346049 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fbd4578a-5445-4ce1-a9dc-c296f2142b76 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:18.346525 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fbd4578a-5445-4ce1-a9dc-c296f2142b76 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:18.346952 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fbd4578a-5445-4ce1-a9dc-c296f2142b76 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:18.347632 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fbd4578a-5445-4ce1-a9dc-c296f2142b76 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:18.348102 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fbd4578a-5445-4ce1-a9dc-c296f2142b76 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:18.348523 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fbd4578a-5445-4ce1-a9dc-c296f2142b76 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:18.384904 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-2290ee3d-1dbc-4be7-b22f-ee2cd9ba4b2e tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:18.387109 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-2290ee3d-1dbc-4be7-b22f-ee2cd9ba4b2e tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 703afaf7-e5a4-486b-a781-4bd2e3b06981] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:18.387506 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-fbd4578a-5445-4ce1-a9dc-c296f2142b76 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: ab871db0-6362-4dd3-b29c-b513351e027b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121231) unshelve /opt/stack/nova/nova/compute/api.py:4544}} Aug 11 11:10:18.393884 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2290ee3d-1dbc-4be7-b22f-ee2cd9ba4b2e tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:18.394363 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2290ee3d-1dbc-4be7-b22f-ee2cd9ba4b2e tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:18.394793 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2290ee3d-1dbc-4be7-b22f-ee2cd9ba4b2e tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:18.395474 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2290ee3d-1dbc-4be7-b22f-ee2cd9ba4b2e tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:18.395956 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2290ee3d-1dbc-4be7-b22f-ee2cd9ba4b2e tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:18.396376 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2290ee3d-1dbc-4be7-b22f-ee2cd9ba4b2e tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:18.426153 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-2290ee3d-1dbc-4be7-b22f-ee2cd9ba4b2e tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/703afaf7-e5a4-486b-a781-4bd2e3b06981/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045080 Aug 11 11:10:18.426705 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 434/851] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Aug 11 11:10:18 2022] GET /compute/v2.1/servers/703afaf7-e5a4-486b-a781-4bd2e3b06981/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 11:10:18.437355 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-3e27e673-02ab-489c-811b-a81c98a6c137 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:18.437850 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-3e27e673-02ab-489c-811b-a81c98a6c137 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 703afaf7-e5a4-486b-a781-4bd2e3b06981] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:18.443400 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3e27e673-02ab-489c-811b-a81c98a6c137 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:18.459638 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3e27e673-02ab-489c-811b-a81c98a6c137 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:18.459638 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3e27e673-02ab-489c-811b-a81c98a6c137 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:18.459638 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3e27e673-02ab-489c-811b-a81c98a6c137 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:18.459638 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3e27e673-02ab-489c-811b-a81c98a6c137 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:18.460064 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3e27e673-02ab-489c-811b-a81c98a6c137 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:18.472996 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-3e27e673-02ab-489c-811b-a81c98a6c137 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/703afaf7-e5a4-486b-a781-4bd2e3b06981/os-volume_attachments/29a5da93-b076-4286-b9a2-11460a3547dd" status: 200 len: 194 microversion: 2.1 time: 0.039218 Aug 11 11:10:18.473570 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 435/852] 10.222.0.48 () {58 vars in 1413 bytes} [Thu Aug 11 11:10:18 2022] GET /compute/v2.1/servers/703afaf7-e5a4-486b-a781-4bd2e3b06981/os-volume_attachments/29a5da93-b076-4286-b9a2-11460a3547dd => generated 194 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 11:10:18.696853 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-fbd4578a-5445-4ce1-a9dc-c296f2142b76 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "POST /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b/action" status: 202 len: 0 microversion: 2.20 time: 0.361680 Aug 11 11:10:18.698291 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 418/853] 10.222.0.48 () {62 vars in 1319 bytes} [Thu Aug 11 11:10:18 2022] POST /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b/action => generated 0 bytes in 363 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 11 11:10:18.706201 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-80875747-3bc9-411e-afa7-f943b6b99009 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:18.706809 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-80875747-3bc9-411e-afa7-f943b6b99009 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: ab871db0-6362-4dd3-b29c-b513351e027b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:18.713289 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-80875747-3bc9-411e-afa7-f943b6b99009 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:18.713770 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-80875747-3bc9-411e-afa7-f943b6b99009 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:18.714203 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-80875747-3bc9-411e-afa7-f943b6b99009 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:18.714882 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-80875747-3bc9-411e-afa7-f943b6b99009 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:18.715337 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-80875747-3bc9-411e-afa7-f943b6b99009 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:18.715832 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-80875747-3bc9-411e-afa7-f943b6b99009 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:18.849636 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-80875747-3bc9-411e-afa7-f943b6b99009 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:18.859260 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-80875747-3bc9-411e-afa7-f943b6b99009 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:18.860947 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-80875747-3bc9-411e-afa7-f943b6b99009 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:18.862124 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-80875747-3bc9-411e-afa7-f943b6b99009 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b" status: 200 len: 1672 microversion: 2.20 time: 0.159868 Aug 11 11:10:18.862673 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 436/854] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:10:18 2022] GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b => generated 1672 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:10:19.147195 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell0:SELECT=4 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:10:19.151950 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-5b99a279-becb-430e-b4f2-c5d840052598 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:19.152705 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-5b99a279-becb-430e-b4f2-c5d840052598 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] [instance: 9c9f7edb-2175-4575-ac11-781015e25a57] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:19.158907 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5b99a279-becb-430e-b4f2-c5d840052598 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:19.159466 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5b99a279-becb-430e-b4f2-c5d840052598 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:19.160022 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5b99a279-becb-430e-b4f2-c5d840052598 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:19.160780 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5b99a279-becb-430e-b4f2-c5d840052598 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:19.161413 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5b99a279-becb-430e-b4f2-c5d840052598 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:19.161845 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5b99a279-becb-430e-b4f2-c5d840052598 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:19.301660 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-5b99a279-becb-430e-b4f2-c5d840052598 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b2f7b56f6d94908bf00b3f21954776c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea40881648b4df393fc35c07d8f68dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:19.311841 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-5b99a279-becb-430e-b4f2-c5d840052598 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] 10.222.0.48 "GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57" status: 200 len: 1272 microversion: 2.1 time: 0.163559 Aug 11 11:10:19.311841 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 419/855] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:10:19 2022] GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57 => generated 1272 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:10:19.885398 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-9c089337-15f6-4390-85dc-66cd80f68e9d tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:19.885988 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-9c089337-15f6-4390-85dc-66cd80f68e9d tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: ab871db0-6362-4dd3-b29c-b513351e027b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:19.892751 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9c089337-15f6-4390-85dc-66cd80f68e9d tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:19.893306 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9c089337-15f6-4390-85dc-66cd80f68e9d tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:19.893788 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9c089337-15f6-4390-85dc-66cd80f68e9d tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:19.894463 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9c089337-15f6-4390-85dc-66cd80f68e9d tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:19.894904 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9c089337-15f6-4390-85dc-66cd80f68e9d tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:19.895318 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9c089337-15f6-4390-85dc-66cd80f68e9d tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:20.024440 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-9c089337-15f6-4390-85dc-66cd80f68e9d tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:20.033273 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-9c089337-15f6-4390-85dc-66cd80f68e9d tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:20.034762 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-9c089337-15f6-4390-85dc-66cd80f68e9d tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:20.035953 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-9c089337-15f6-4390-85dc-66cd80f68e9d tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b" status: 200 len: 1672 microversion: 2.20 time: 0.154798 Aug 11 11:10:20.036504 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 437/856] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:10:19 2022] GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b => generated 1672 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:10:20.243233 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-7e0153b1-ac16-4e11-bf4a-54d2afbbe9fd tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b8bff282-e1ea-4786-a117-cdff73a5711b"}} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:10:20.246295 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-7e0153b1-ac16-4e11-bf4a-54d2afbbe9fd tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 703afaf7-e5a4-486b-a781-4bd2e3b06981] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:20.253321 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7e0153b1-ac16-4e11-bf4a-54d2afbbe9fd tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:20.253806 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7e0153b1-ac16-4e11-bf4a-54d2afbbe9fd tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:20.254468 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7e0153b1-ac16-4e11-bf4a-54d2afbbe9fd tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:20.255178 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7e0153b1-ac16-4e11-bf4a-54d2afbbe9fd tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:20.255631 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7e0153b1-ac16-4e11-bf4a-54d2afbbe9fd tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:20.256117 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7e0153b1-ac16-4e11-bf4a-54d2afbbe9fd tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:20.332322 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-9248b525-1e5d-4559-925c-0bfb908d753e tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:20.332928 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-9248b525-1e5d-4559-925c-0bfb908d753e tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] [instance: 9c9f7edb-2175-4575-ac11-781015e25a57] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:20.340525 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9248b525-1e5d-4559-925c-0bfb908d753e tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:20.341013 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9248b525-1e5d-4559-925c-0bfb908d753e tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:20.341448 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9248b525-1e5d-4559-925c-0bfb908d753e tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:20.342138 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9248b525-1e5d-4559-925c-0bfb908d753e tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:20.342592 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9248b525-1e5d-4559-925c-0bfb908d753e tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:20.343016 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9248b525-1e5d-4559-925c-0bfb908d753e tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:20.478458 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-9248b525-1e5d-4559-925c-0bfb908d753e tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b2f7b56f6d94908bf00b3f21954776c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea40881648b4df393fc35c07d8f68dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:20.486933 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-9248b525-1e5d-4559-925c-0bfb908d753e tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] 10.222.0.48 "GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57" status: 200 len: 1260 microversion: 2.1 time: 0.158787 Aug 11 11:10:20.487489 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 438/857] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:10:20 2022] GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:10:21.030329 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-7e0153b1-ac16-4e11-bf4a-54d2afbbe9fd tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "POST /compute/v2.1/servers/703afaf7-e5a4-486b-a781-4bd2e3b06981/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.790774 Aug 11 11:10:21.030860 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 420/858] 10.222.0.48 () {60 vars in 1323 bytes} [Thu Aug 11 11:10:20 2022] POST /compute/v2.1/servers/703afaf7-e5a4-486b-a781-4bd2e3b06981/os-volume_attachments => generated 194 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:10:21.059911 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-7017313f-d005-40ec-b67e-182bb625780f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:21.060511 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-7017313f-d005-40ec-b67e-182bb625780f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: ab871db0-6362-4dd3-b29c-b513351e027b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:21.066835 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7017313f-d005-40ec-b67e-182bb625780f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:21.067317 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7017313f-d005-40ec-b67e-182bb625780f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:21.067744 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7017313f-d005-40ec-b67e-182bb625780f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:21.068462 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7017313f-d005-40ec-b67e-182bb625780f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:21.068893 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7017313f-d005-40ec-b67e-182bb625780f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:21.069309 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7017313f-d005-40ec-b67e-182bb625780f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:21.200945 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-7017313f-d005-40ec-b67e-182bb625780f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:21.208984 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-7017313f-d005-40ec-b67e-182bb625780f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:21.210490 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-7017313f-d005-40ec-b67e-182bb625780f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:21.211646 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-7017313f-d005-40ec-b67e-182bb625780f tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b" status: 200 len: 1730 microversion: 2.20 time: 0.155709 Aug 11 11:10:21.212239 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 439/859] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:10:21 2022] GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:10:21.508721 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-ad2621b1-2c1c-4afd-9fa7-6316574e63c9 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:21.509420 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-ad2621b1-2c1c-4afd-9fa7-6316574e63c9 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] [instance: 9c9f7edb-2175-4575-ac11-781015e25a57] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:21.517139 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ad2621b1-2c1c-4afd-9fa7-6316574e63c9 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:21.517625 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ad2621b1-2c1c-4afd-9fa7-6316574e63c9 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:21.518054 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ad2621b1-2c1c-4afd-9fa7-6316574e63c9 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:21.518754 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ad2621b1-2c1c-4afd-9fa7-6316574e63c9 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:21.519205 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ad2621b1-2c1c-4afd-9fa7-6316574e63c9 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:21.519653 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ad2621b1-2c1c-4afd-9fa7-6316574e63c9 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:21.526890 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=5,nova_cell1:UPDATE=7 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:10:21.820119 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-ad2621b1-2c1c-4afd-9fa7-6316574e63c9 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b2f7b56f6d94908bf00b3f21954776c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea40881648b4df393fc35c07d8f68dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:21.828623 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-ad2621b1-2c1c-4afd-9fa7-6316574e63c9 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] 10.222.0.48 "GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57" status: 200 len: 1260 microversion: 2.1 time: 0.324157 Aug 11 11:10:21.829369 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 421/860] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:10:21 2022] GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57 => generated 1260 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:10:22.235851 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-4c6fea95-829e-4a6e-bf3d-e7c1cc2ed893 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:22.236456 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-4c6fea95-829e-4a6e-bf3d-e7c1cc2ed893 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: ab871db0-6362-4dd3-b29c-b513351e027b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:22.242955 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4c6fea95-829e-4a6e-bf3d-e7c1cc2ed893 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:22.243427 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4c6fea95-829e-4a6e-bf3d-e7c1cc2ed893 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:22.243901 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4c6fea95-829e-4a6e-bf3d-e7c1cc2ed893 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:22.245182 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4c6fea95-829e-4a6e-bf3d-e7c1cc2ed893 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:22.245631 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4c6fea95-829e-4a6e-bf3d-e7c1cc2ed893 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:22.246050 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4c6fea95-829e-4a6e-bf3d-e7c1cc2ed893 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:22.383287 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-4c6fea95-829e-4a6e-bf3d-e7c1cc2ed893 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:22.395073 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-4c6fea95-829e-4a6e-bf3d-e7c1cc2ed893 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:22.399886 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-4c6fea95-829e-4a6e-bf3d-e7c1cc2ed893 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:22.399886 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-4c6fea95-829e-4a6e-bf3d-e7c1cc2ed893 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b" status: 200 len: 1730 microversion: 2.20 time: 0.167143 Aug 11 11:10:22.420278 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 440/861] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:10:22 2022] GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b => generated 1730 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:10:22.849359 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-a4b8e714-13ed-4f18-9ede-f9b0558990a7 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:22.849969 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-a4b8e714-13ed-4f18-9ede-f9b0558990a7 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] [instance: 9c9f7edb-2175-4575-ac11-781015e25a57] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:22.857132 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a4b8e714-13ed-4f18-9ede-f9b0558990a7 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:22.857809 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a4b8e714-13ed-4f18-9ede-f9b0558990a7 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:22.858253 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a4b8e714-13ed-4f18-9ede-f9b0558990a7 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:22.859029 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a4b8e714-13ed-4f18-9ede-f9b0558990a7 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:22.859411 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a4b8e714-13ed-4f18-9ede-f9b0558990a7 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:22.859934 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a4b8e714-13ed-4f18-9ede-f9b0558990a7 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:22.997649 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-a4b8e714-13ed-4f18-9ede-f9b0558990a7 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b2f7b56f6d94908bf00b3f21954776c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea40881648b4df393fc35c07d8f68dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:23.005490 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-a4b8e714-13ed-4f18-9ede-f9b0558990a7 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] 10.222.0.48 "GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57" status: 200 len: 1260 microversion: 2.1 time: 0.159977 Aug 11 11:10:23.006146 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 422/862] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:10:22 2022] GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:10:23.424106 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-64216c76-17ad-4719-8463-100108f9b99e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:23.424673 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-64216c76-17ad-4719-8463-100108f9b99e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: ab871db0-6362-4dd3-b29c-b513351e027b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:23.431084 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-64216c76-17ad-4719-8463-100108f9b99e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:23.431565 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-64216c76-17ad-4719-8463-100108f9b99e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:23.432032 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-64216c76-17ad-4719-8463-100108f9b99e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:23.432774 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-64216c76-17ad-4719-8463-100108f9b99e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:23.433222 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-64216c76-17ad-4719-8463-100108f9b99e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:23.433649 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-64216c76-17ad-4719-8463-100108f9b99e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:23.578501 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-64216c76-17ad-4719-8463-100108f9b99e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:23.587010 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-64216c76-17ad-4719-8463-100108f9b99e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:23.589113 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-64216c76-17ad-4719-8463-100108f9b99e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:23.590507 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-64216c76-17ad-4719-8463-100108f9b99e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b" status: 200 len: 1730 microversion: 2.20 time: 0.170402 Aug 11 11:10:23.591068 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 441/863] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:10:23 2022] GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:10:24.026707 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-1e22fe00-96f0-47d7-9870-783f8d4cca9d tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:24.027313 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-1e22fe00-96f0-47d7-9870-783f8d4cca9d tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] [instance: 9c9f7edb-2175-4575-ac11-781015e25a57] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:24.034026 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1e22fe00-96f0-47d7-9870-783f8d4cca9d tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:24.034500 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1e22fe00-96f0-47d7-9870-783f8d4cca9d tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:24.034929 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1e22fe00-96f0-47d7-9870-783f8d4cca9d tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:24.035608 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1e22fe00-96f0-47d7-9870-783f8d4cca9d tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:24.036084 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1e22fe00-96f0-47d7-9870-783f8d4cca9d tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:24.036502 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1e22fe00-96f0-47d7-9870-783f8d4cca9d tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:24.177319 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-1e22fe00-96f0-47d7-9870-783f8d4cca9d tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b2f7b56f6d94908bf00b3f21954776c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea40881648b4df393fc35c07d8f68dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:24.185788 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-1e22fe00-96f0-47d7-9870-783f8d4cca9d tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] 10.222.0.48 "GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57" status: 200 len: 1260 microversion: 2.1 time: 0.163030 Aug 11 11:10:24.186357 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 423/864] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:10:24 2022] GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57 => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:10:24.613579 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-13b162ea-65d7-4f07-a221-b08edd8fbec1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:24.615084 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-13b162ea-65d7-4f07-a221-b08edd8fbec1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: ab871db0-6362-4dd3-b29c-b513351e027b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:24.622941 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-13b162ea-65d7-4f07-a221-b08edd8fbec1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:24.623426 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-13b162ea-65d7-4f07-a221-b08edd8fbec1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:24.623885 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-13b162ea-65d7-4f07-a221-b08edd8fbec1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:24.624585 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-13b162ea-65d7-4f07-a221-b08edd8fbec1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:24.625031 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-13b162ea-65d7-4f07-a221-b08edd8fbec1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:24.625451 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-13b162ea-65d7-4f07-a221-b08edd8fbec1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:24.755570 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-13b162ea-65d7-4f07-a221-b08edd8fbec1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:24.764122 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-13b162ea-65d7-4f07-a221-b08edd8fbec1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:24.766465 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-13b162ea-65d7-4f07-a221-b08edd8fbec1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:24.767963 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-13b162ea-65d7-4f07-a221-b08edd8fbec1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b" status: 200 len: 1730 microversion: 2.20 time: 0.158638 Aug 11 11:10:24.768643 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 442/865] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:10:24 2022] GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:10:25.206522 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-1c92fb92-66db-488c-84dd-a5da856b3435 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:25.207129 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-1c92fb92-66db-488c-84dd-a5da856b3435 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] [instance: 9c9f7edb-2175-4575-ac11-781015e25a57] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:25.214199 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1c92fb92-66db-488c-84dd-a5da856b3435 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:25.214677 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1c92fb92-66db-488c-84dd-a5da856b3435 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:25.215105 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1c92fb92-66db-488c-84dd-a5da856b3435 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:25.215809 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1c92fb92-66db-488c-84dd-a5da856b3435 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:25.216254 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1c92fb92-66db-488c-84dd-a5da856b3435 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:25.216674 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1c92fb92-66db-488c-84dd-a5da856b3435 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:25.373070 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-1c92fb92-66db-488c-84dd-a5da856b3435 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b2f7b56f6d94908bf00b3f21954776c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea40881648b4df393fc35c07d8f68dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:25.381382 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-1c92fb92-66db-488c-84dd-a5da856b3435 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] 10.222.0.48 "GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57" status: 200 len: 1260 microversion: 2.1 time: 0.178629 Aug 11 11:10:25.381954 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 424/866] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:10:25 2022] GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57 => generated 1260 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:10:25.792390 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-db81fb44-0347-4645-a472-412ba5ad4095 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:25.793867 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-db81fb44-0347-4645-a472-412ba5ad4095 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: ab871db0-6362-4dd3-b29c-b513351e027b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:25.800693 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-db81fb44-0347-4645-a472-412ba5ad4095 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:25.801189 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-db81fb44-0347-4645-a472-412ba5ad4095 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:25.801624 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-db81fb44-0347-4645-a472-412ba5ad4095 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:25.802315 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-db81fb44-0347-4645-a472-412ba5ad4095 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:25.802799 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-db81fb44-0347-4645-a472-412ba5ad4095 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:25.803241 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-db81fb44-0347-4645-a472-412ba5ad4095 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:25.942805 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-db81fb44-0347-4645-a472-412ba5ad4095 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:25.955127 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-db81fb44-0347-4645-a472-412ba5ad4095 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:25.956798 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-db81fb44-0347-4645-a472-412ba5ad4095 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:25.958089 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-db81fb44-0347-4645-a472-412ba5ad4095 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b" status: 200 len: 1730 microversion: 2.20 time: 0.170732 Aug 11 11:10:25.958760 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 443/867] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:10:25 2022] GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:10:26.401430 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-d26f0315-7569-4c73-b227-c2b7694b5db1 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:26.402118 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-d26f0315-7569-4c73-b227-c2b7694b5db1 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] [instance: 9c9f7edb-2175-4575-ac11-781015e25a57] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:26.409314 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d26f0315-7569-4c73-b227-c2b7694b5db1 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:26.418704 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d26f0315-7569-4c73-b227-c2b7694b5db1 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:26.419229 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d26f0315-7569-4c73-b227-c2b7694b5db1 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:26.420335 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d26f0315-7569-4c73-b227-c2b7694b5db1 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:26.421153 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d26f0315-7569-4c73-b227-c2b7694b5db1 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:26.421932 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d26f0315-7569-4c73-b227-c2b7694b5db1 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:26.571447 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-d26f0315-7569-4c73-b227-c2b7694b5db1 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b2f7b56f6d94908bf00b3f21954776c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea40881648b4df393fc35c07d8f68dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:26.580866 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-d26f0315-7569-4c73-b227-c2b7694b5db1 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] 10.222.0.48 "GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57" status: 200 len: 1260 microversion: 2.1 time: 0.183044 Aug 11 11:10:26.581632 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 425/868] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:10:26 2022] GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57 => generated 1260 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:10:26.981991 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-40c0f90a-8f83-4aa3-8abd-06543283fb6e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:26.982601 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-40c0f90a-8f83-4aa3-8abd-06543283fb6e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: ab871db0-6362-4dd3-b29c-b513351e027b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:26.990663 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-40c0f90a-8f83-4aa3-8abd-06543283fb6e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:26.991291 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-40c0f90a-8f83-4aa3-8abd-06543283fb6e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:26.991980 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-40c0f90a-8f83-4aa3-8abd-06543283fb6e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:26.992889 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-40c0f90a-8f83-4aa3-8abd-06543283fb6e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:26.993402 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-40c0f90a-8f83-4aa3-8abd-06543283fb6e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:26.993888 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-40c0f90a-8f83-4aa3-8abd-06543283fb6e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:27.129185 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-40c0f90a-8f83-4aa3-8abd-06543283fb6e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:27.137722 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-40c0f90a-8f83-4aa3-8abd-06543283fb6e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:27.139228 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-40c0f90a-8f83-4aa3-8abd-06543283fb6e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:27.140419 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-40c0f90a-8f83-4aa3-8abd-06543283fb6e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b" status: 200 len: 1730 microversion: 2.20 time: 0.162945 Aug 11 11:10:27.140976 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 444/869] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:10:26 2022] GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:10:27.601846 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-c7f7185c-3bf5-46b6-9d69-1fd755e1a6fc tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:27.602851 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-c7f7185c-3bf5-46b6-9d69-1fd755e1a6fc tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] [instance: 9c9f7edb-2175-4575-ac11-781015e25a57] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:27.609546 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c7f7185c-3bf5-46b6-9d69-1fd755e1a6fc tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:27.610158 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c7f7185c-3bf5-46b6-9d69-1fd755e1a6fc tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:27.610486 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c7f7185c-3bf5-46b6-9d69-1fd755e1a6fc tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:27.611166 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c7f7185c-3bf5-46b6-9d69-1fd755e1a6fc tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:27.611616 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c7f7185c-3bf5-46b6-9d69-1fd755e1a6fc tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:27.612059 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c7f7185c-3bf5-46b6-9d69-1fd755e1a6fc tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:27.755445 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-c7f7185c-3bf5-46b6-9d69-1fd755e1a6fc tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b2f7b56f6d94908bf00b3f21954776c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea40881648b4df393fc35c07d8f68dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:27.763929 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-c7f7185c-3bf5-46b6-9d69-1fd755e1a6fc tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] 10.222.0.48 "GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57" status: 200 len: 1260 microversion: 2.1 time: 0.165820 Aug 11 11:10:27.764711 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 426/870] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:10:27 2022] GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57 => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:10:28.169741 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-df89ae0c-1b05-47d3-9e32-3eb13504feb2 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:28.170393 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-df89ae0c-1b05-47d3-9e32-3eb13504feb2 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: ab871db0-6362-4dd3-b29c-b513351e027b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:28.177161 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-df89ae0c-1b05-47d3-9e32-3eb13504feb2 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:28.177637 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-df89ae0c-1b05-47d3-9e32-3eb13504feb2 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:28.178064 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-df89ae0c-1b05-47d3-9e32-3eb13504feb2 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:28.178757 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-df89ae0c-1b05-47d3-9e32-3eb13504feb2 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:28.179212 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-df89ae0c-1b05-47d3-9e32-3eb13504feb2 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:28.179631 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-df89ae0c-1b05-47d3-9e32-3eb13504feb2 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:28.323299 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-df89ae0c-1b05-47d3-9e32-3eb13504feb2 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:28.331479 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-df89ae0c-1b05-47d3-9e32-3eb13504feb2 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:28.333200 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-df89ae0c-1b05-47d3-9e32-3eb13504feb2 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:28.334358 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-df89ae0c-1b05-47d3-9e32-3eb13504feb2 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b" status: 200 len: 1730 microversion: 2.20 time: 0.173627 Aug 11 11:10:28.334925 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 445/871] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:10:28 2022] GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:10:28.784865 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-74e0ad3b-38de-40d4-ba9e-ab4ecedbd4f3 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:28.785614 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-74e0ad3b-38de-40d4-ba9e-ab4ecedbd4f3 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] [instance: 9c9f7edb-2175-4575-ac11-781015e25a57] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:28.792962 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-74e0ad3b-38de-40d4-ba9e-ab4ecedbd4f3 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:28.793828 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-74e0ad3b-38de-40d4-ba9e-ab4ecedbd4f3 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:28.795187 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-74e0ad3b-38de-40d4-ba9e-ab4ecedbd4f3 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:28.796002 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-74e0ad3b-38de-40d4-ba9e-ab4ecedbd4f3 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:28.796821 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-74e0ad3b-38de-40d4-ba9e-ab4ecedbd4f3 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:28.797317 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-74e0ad3b-38de-40d4-ba9e-ab4ecedbd4f3 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:28.936738 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-74e0ad3b-38de-40d4-ba9e-ab4ecedbd4f3 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b2f7b56f6d94908bf00b3f21954776c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea40881648b4df393fc35c07d8f68dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:28.944505 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-74e0ad3b-38de-40d4-ba9e-ab4ecedbd4f3 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] 10.222.0.48 "GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57" status: 200 len: 1260 microversion: 2.1 time: 0.163515 Aug 11 11:10:28.946628 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 427/872] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:10:28 2022] GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57 => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:10:29.357946 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-f8065db2-64e6-480b-9bb5-147582605ae9 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:29.358546 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-f8065db2-64e6-480b-9bb5-147582605ae9 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: ab871db0-6362-4dd3-b29c-b513351e027b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:29.365018 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f8065db2-64e6-480b-9bb5-147582605ae9 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:29.365494 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f8065db2-64e6-480b-9bb5-147582605ae9 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:29.365924 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f8065db2-64e6-480b-9bb5-147582605ae9 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:29.366601 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f8065db2-64e6-480b-9bb5-147582605ae9 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:29.367052 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f8065db2-64e6-480b-9bb5-147582605ae9 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:29.367468 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f8065db2-64e6-480b-9bb5-147582605ae9 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:29.371986 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:10:29.508848 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-f8065db2-64e6-480b-9bb5-147582605ae9 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:29.519310 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-f8065db2-64e6-480b-9bb5-147582605ae9 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:29.522886 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-f8065db2-64e6-480b-9bb5-147582605ae9 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:29.522886 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-f8065db2-64e6-480b-9bb5-147582605ae9 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b" status: 200 len: 1730 microversion: 2.20 time: 0.168405 Aug 11 11:10:29.522886 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 446/873] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:10:29 2022] GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:10:29.966602 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-f1bed63c-bfe5-46e7-92fb-e7aa68003d82 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:29.967266 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-f1bed63c-bfe5-46e7-92fb-e7aa68003d82 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] [instance: 9c9f7edb-2175-4575-ac11-781015e25a57] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:29.973726 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f1bed63c-bfe5-46e7-92fb-e7aa68003d82 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:29.974212 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f1bed63c-bfe5-46e7-92fb-e7aa68003d82 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:29.974648 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f1bed63c-bfe5-46e7-92fb-e7aa68003d82 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:29.975339 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f1bed63c-bfe5-46e7-92fb-e7aa68003d82 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:29.975817 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f1bed63c-bfe5-46e7-92fb-e7aa68003d82 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:29.976247 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f1bed63c-bfe5-46e7-92fb-e7aa68003d82 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:30.114451 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-f1bed63c-bfe5-46e7-92fb-e7aa68003d82 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b2f7b56f6d94908bf00b3f21954776c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea40881648b4df393fc35c07d8f68dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:30.122243 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-f1bed63c-bfe5-46e7-92fb-e7aa68003d82 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] 10.222.0.48 "GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57" status: 200 len: 1260 microversion: 2.1 time: 0.159958 Aug 11 11:10:30.122894 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 428/874] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:10:29 2022] GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:10:30.548115 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-5ade1ec6-9023-4595-b690-3390cf70e323 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:30.548984 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-5ade1ec6-9023-4595-b690-3390cf70e323 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: ab871db0-6362-4dd3-b29c-b513351e027b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:30.560505 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5ade1ec6-9023-4595-b690-3390cf70e323 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:30.567309 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5ade1ec6-9023-4595-b690-3390cf70e323 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:30.567309 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5ade1ec6-9023-4595-b690-3390cf70e323 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:30.567309 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5ade1ec6-9023-4595-b690-3390cf70e323 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:30.567309 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5ade1ec6-9023-4595-b690-3390cf70e323 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:30.567730 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5ade1ec6-9023-4595-b690-3390cf70e323 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:30.720675 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-5ade1ec6-9023-4595-b690-3390cf70e323 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:30.728804 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-5ade1ec6-9023-4595-b690-3390cf70e323 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:30.730420 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-5ade1ec6-9023-4595-b690-3390cf70e323 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:30.731564 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-5ade1ec6-9023-4595-b690-3390cf70e323 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b" status: 200 len: 1730 microversion: 2.20 time: 0.188538 Aug 11 11:10:30.732155 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 447/875] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:10:30 2022] GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b => generated 1730 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:10:31.143884 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-769ac485-c9e9-4626-bdca-8f22d91f4288 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:31.144616 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-769ac485-c9e9-4626-bdca-8f22d91f4288 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] [instance: 9c9f7edb-2175-4575-ac11-781015e25a57] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:31.151246 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-769ac485-c9e9-4626-bdca-8f22d91f4288 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:31.151728 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-769ac485-c9e9-4626-bdca-8f22d91f4288 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:31.152189 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-769ac485-c9e9-4626-bdca-8f22d91f4288 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:31.152905 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-769ac485-c9e9-4626-bdca-8f22d91f4288 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:31.153361 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-769ac485-c9e9-4626-bdca-8f22d91f4288 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:31.153788 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-769ac485-c9e9-4626-bdca-8f22d91f4288 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:31.282081 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-769ac485-c9e9-4626-bdca-8f22d91f4288 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b2f7b56f6d94908bf00b3f21954776c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea40881648b4df393fc35c07d8f68dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:31.289468 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-769ac485-c9e9-4626-bdca-8f22d91f4288 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] 10.222.0.48 "GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57" status: 200 len: 1260 microversion: 2.1 time: 0.149458 Aug 11 11:10:31.290037 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 429/876] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:10:31 2022] GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57 => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:10:31.755653 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-e9e2893b-8a43-40f0-ac29-ec0db9a6c585 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:31.756922 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-e9e2893b-8a43-40f0-ac29-ec0db9a6c585 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: ab871db0-6362-4dd3-b29c-b513351e027b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:31.764060 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e9e2893b-8a43-40f0-ac29-ec0db9a6c585 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:31.764542 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e9e2893b-8a43-40f0-ac29-ec0db9a6c585 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:31.764971 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e9e2893b-8a43-40f0-ac29-ec0db9a6c585 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:31.765688 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e9e2893b-8a43-40f0-ac29-ec0db9a6c585 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:31.766132 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e9e2893b-8a43-40f0-ac29-ec0db9a6c585 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:31.766548 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e9e2893b-8a43-40f0-ac29-ec0db9a6c585 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:31.896669 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-e9e2893b-8a43-40f0-ac29-ec0db9a6c585 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:31.905777 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-e9e2893b-8a43-40f0-ac29-ec0db9a6c585 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:31.907332 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-e9e2893b-8a43-40f0-ac29-ec0db9a6c585 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:31.908567 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-e9e2893b-8a43-40f0-ac29-ec0db9a6c585 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b" status: 200 len: 1730 microversion: 2.20 time: 0.156815 Aug 11 11:10:31.913723 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 448/877] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:10:31 2022] GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:10:32.310360 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-29726aaa-7cff-4244-b50c-30a2e9ea74c8 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:32.310960 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-29726aaa-7cff-4244-b50c-30a2e9ea74c8 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] [instance: 9c9f7edb-2175-4575-ac11-781015e25a57] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:32.317339 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-29726aaa-7cff-4244-b50c-30a2e9ea74c8 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:32.317812 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-29726aaa-7cff-4244-b50c-30a2e9ea74c8 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:32.318235 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-29726aaa-7cff-4244-b50c-30a2e9ea74c8 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:32.318911 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-29726aaa-7cff-4244-b50c-30a2e9ea74c8 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:32.319360 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-29726aaa-7cff-4244-b50c-30a2e9ea74c8 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:32.319796 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-29726aaa-7cff-4244-b50c-30a2e9ea74c8 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:32.452148 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-29726aaa-7cff-4244-b50c-30a2e9ea74c8 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b2f7b56f6d94908bf00b3f21954776c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea40881648b4df393fc35c07d8f68dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:32.459694 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-29726aaa-7cff-4244-b50c-30a2e9ea74c8 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] 10.222.0.48 "GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57" status: 200 len: 1260 microversion: 2.1 time: 0.153152 Aug 11 11:10:32.460284 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 430/878] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:10:32 2022] GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:10:32.931801 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-61d79e31-fcd5-4207-adb6-27d9e8df5556 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:32.932410 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-61d79e31-fcd5-4207-adb6-27d9e8df5556 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: ab871db0-6362-4dd3-b29c-b513351e027b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:32.938944 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-61d79e31-fcd5-4207-adb6-27d9e8df5556 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:32.939425 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-61d79e31-fcd5-4207-adb6-27d9e8df5556 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:32.939957 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-61d79e31-fcd5-4207-adb6-27d9e8df5556 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:32.940653 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-61d79e31-fcd5-4207-adb6-27d9e8df5556 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:32.941111 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-61d79e31-fcd5-4207-adb6-27d9e8df5556 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:32.947600 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-61d79e31-fcd5-4207-adb6-27d9e8df5556 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:33.068137 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-61d79e31-fcd5-4207-adb6-27d9e8df5556 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:33.076586 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-61d79e31-fcd5-4207-adb6-27d9e8df5556 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:33.078066 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-61d79e31-fcd5-4207-adb6-27d9e8df5556 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:33.079201 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-61d79e31-fcd5-4207-adb6-27d9e8df5556 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b" status: 200 len: 1730 microversion: 2.20 time: 0.151313 Aug 11 11:10:33.079770 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 449/879] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:10:32 2022] GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:10:33.480906 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-d9d3c206-f675-4bad-8f2d-17c0b5889fb9 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:33.481509 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-d9d3c206-f675-4bad-8f2d-17c0b5889fb9 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] [instance: 9c9f7edb-2175-4575-ac11-781015e25a57] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:33.487906 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d9d3c206-f675-4bad-8f2d-17c0b5889fb9 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:33.488382 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d9d3c206-f675-4bad-8f2d-17c0b5889fb9 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:33.488819 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d9d3c206-f675-4bad-8f2d-17c0b5889fb9 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:33.489487 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d9d3c206-f675-4bad-8f2d-17c0b5889fb9 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:33.489934 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d9d3c206-f675-4bad-8f2d-17c0b5889fb9 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:33.490350 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d9d3c206-f675-4bad-8f2d-17c0b5889fb9 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:33.623854 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-d9d3c206-f675-4bad-8f2d-17c0b5889fb9 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b2f7b56f6d94908bf00b3f21954776c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea40881648b4df393fc35c07d8f68dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:33.631327 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-d9d3c206-f675-4bad-8f2d-17c0b5889fb9 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] 10.222.0.48 "GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57" status: 200 len: 1260 microversion: 2.1 time: 0.154242 Aug 11 11:10:33.631910 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 431/880] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:10:33 2022] GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:10:34.101911 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-440b7694-e09a-4157-8685-f6bc924eb1c5 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:34.102456 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-440b7694-e09a-4157-8685-f6bc924eb1c5 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: ab871db0-6362-4dd3-b29c-b513351e027b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:34.108880 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-440b7694-e09a-4157-8685-f6bc924eb1c5 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:34.109361 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-440b7694-e09a-4157-8685-f6bc924eb1c5 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:34.109795 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-440b7694-e09a-4157-8685-f6bc924eb1c5 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:34.110473 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-440b7694-e09a-4157-8685-f6bc924eb1c5 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:34.110920 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-440b7694-e09a-4157-8685-f6bc924eb1c5 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:34.111336 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-440b7694-e09a-4157-8685-f6bc924eb1c5 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:34.237816 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-440b7694-e09a-4157-8685-f6bc924eb1c5 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:34.246120 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-440b7694-e09a-4157-8685-f6bc924eb1c5 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:34.247621 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-440b7694-e09a-4157-8685-f6bc924eb1c5 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:34.248795 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-440b7694-e09a-4157-8685-f6bc924eb1c5 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b" status: 200 len: 1730 microversion: 2.20 time: 0.150867 Aug 11 11:10:34.249368 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 450/881] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:10:34 2022] GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:10:34.652720 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-87305ef8-e15a-44a2-9f55-cb60221e5a80 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:34.653329 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-87305ef8-e15a-44a2-9f55-cb60221e5a80 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] [instance: 9c9f7edb-2175-4575-ac11-781015e25a57] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:34.659915 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-87305ef8-e15a-44a2-9f55-cb60221e5a80 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:34.660398 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-87305ef8-e15a-44a2-9f55-cb60221e5a80 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:34.660833 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-87305ef8-e15a-44a2-9f55-cb60221e5a80 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:34.661516 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-87305ef8-e15a-44a2-9f55-cb60221e5a80 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:34.661969 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-87305ef8-e15a-44a2-9f55-cb60221e5a80 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:34.662442 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-87305ef8-e15a-44a2-9f55-cb60221e5a80 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:34.800551 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-87305ef8-e15a-44a2-9f55-cb60221e5a80 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b2f7b56f6d94908bf00b3f21954776c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea40881648b4df393fc35c07d8f68dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:34.808740 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-87305ef8-e15a-44a2-9f55-cb60221e5a80 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] 10.222.0.48 "GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57" status: 200 len: 1260 microversion: 2.1 time: 0.159921 Aug 11 11:10:34.809299 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 432/882] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:10:34 2022] GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:10:35.271908 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-7cbabb7e-698e-4dc4-9950-6dbf60d06d3a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:35.289272 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-7cbabb7e-698e-4dc4-9950-6dbf60d06d3a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: ab871db0-6362-4dd3-b29c-b513351e027b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:35.289272 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7cbabb7e-698e-4dc4-9950-6dbf60d06d3a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:35.289272 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7cbabb7e-698e-4dc4-9950-6dbf60d06d3a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:35.289272 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7cbabb7e-698e-4dc4-9950-6dbf60d06d3a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:35.289700 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7cbabb7e-698e-4dc4-9950-6dbf60d06d3a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:35.289700 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7cbabb7e-698e-4dc4-9950-6dbf60d06d3a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:35.289700 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7cbabb7e-698e-4dc4-9950-6dbf60d06d3a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:35.422720 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-7cbabb7e-698e-4dc4-9950-6dbf60d06d3a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:35.430656 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-7cbabb7e-698e-4dc4-9950-6dbf60d06d3a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:35.432189 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-7cbabb7e-698e-4dc4-9950-6dbf60d06d3a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:35.433352 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-7cbabb7e-698e-4dc4-9950-6dbf60d06d3a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b" status: 200 len: 1730 microversion: 2.20 time: 0.165418 Aug 11 11:10:35.433908 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 451/883] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:10:35 2022] GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:10:35.828808 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-656690cf-12bb-4999-b01b-1fc48023be71 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:35.829454 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-656690cf-12bb-4999-b01b-1fc48023be71 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] [instance: 9c9f7edb-2175-4575-ac11-781015e25a57] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:35.835970 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-656690cf-12bb-4999-b01b-1fc48023be71 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:35.836455 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-656690cf-12bb-4999-b01b-1fc48023be71 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:35.836892 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-656690cf-12bb-4999-b01b-1fc48023be71 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:35.838189 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-656690cf-12bb-4999-b01b-1fc48023be71 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:35.838556 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-656690cf-12bb-4999-b01b-1fc48023be71 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:35.838985 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-656690cf-12bb-4999-b01b-1fc48023be71 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:35.974632 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-656690cf-12bb-4999-b01b-1fc48023be71 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b2f7b56f6d94908bf00b3f21954776c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea40881648b4df393fc35c07d8f68dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:35.982619 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-656690cf-12bb-4999-b01b-1fc48023be71 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] 10.222.0.48 "GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57" status: 200 len: 1260 microversion: 2.1 time: 0.157755 Aug 11 11:10:35.983188 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 433/884] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:10:35 2022] GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:10:36.010444 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-5c2895c0-146e-4839-a96a-c4d344289c47 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:36.012685 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-5c2895c0-146e-4839-a96a-c4d344289c47 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 703afaf7-e5a4-486b-a781-4bd2e3b06981] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:36.018625 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5c2895c0-146e-4839-a96a-c4d344289c47 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:36.019100 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5c2895c0-146e-4839-a96a-c4d344289c47 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:36.019529 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5c2895c0-146e-4839-a96a-c4d344289c47 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:36.020250 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5c2895c0-146e-4839-a96a-c4d344289c47 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:36.020698 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5c2895c0-146e-4839-a96a-c4d344289c47 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:36.025916 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5c2895c0-146e-4839-a96a-c4d344289c47 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:36.202242 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-5c2895c0-146e-4839-a96a-c4d344289c47 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/703afaf7-e5a4-486b-a781-4bd2e3b06981/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.195612 Aug 11 11:10:36.202811 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 452/885] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Aug 11 11:10:36 2022] GET /compute/v2.1/servers/703afaf7-e5a4-486b-a781-4bd2e3b06981/os-volume_attachments => generated 371 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:10:36.357392 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-3cf4a2a3-5505-4e1f-999b-e52afec5b886 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:36.357894 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-3cf4a2a3-5505-4e1f-999b-e52afec5b886 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 703afaf7-e5a4-486b-a781-4bd2e3b06981] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:36.363889 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3cf4a2a3-5505-4e1f-999b-e52afec5b886 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:36.364739 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3cf4a2a3-5505-4e1f-999b-e52afec5b886 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:36.364857 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3cf4a2a3-5505-4e1f-999b-e52afec5b886 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:36.365488 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3cf4a2a3-5505-4e1f-999b-e52afec5b886 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:36.365948 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3cf4a2a3-5505-4e1f-999b-e52afec5b886 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:36.366377 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3cf4a2a3-5505-4e1f-999b-e52afec5b886 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:36.397403 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-3cf4a2a3-5505-4e1f-999b-e52afec5b886 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/703afaf7-e5a4-486b-a781-4bd2e3b06981/os-volume_attachments/29a5da93-b076-4286-b9a2-11460a3547dd" status: 200 len: 194 microversion: 2.1 time: 0.043893 Aug 11 11:10:36.399601 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 434/886] 10.222.0.48 () {58 vars in 1413 bytes} [Thu Aug 11 11:10:36 2022] GET /compute/v2.1/servers/703afaf7-e5a4-486b-a781-4bd2e3b06981/os-volume_attachments/29a5da93-b076-4286-b9a2-11460a3547dd => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:10:36.409862 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-593a7e3b-95ce-4508-b923-003b5c2cae7f tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:36.410405 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-593a7e3b-95ce-4508-b923-003b5c2cae7f tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 703afaf7-e5a4-486b-a781-4bd2e3b06981] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:36.416784 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-593a7e3b-95ce-4508-b923-003b5c2cae7f tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:36.417259 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-593a7e3b-95ce-4508-b923-003b5c2cae7f tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:36.417686 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-593a7e3b-95ce-4508-b923-003b5c2cae7f tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:36.418360 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-593a7e3b-95ce-4508-b923-003b5c2cae7f tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:36.418803 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-593a7e3b-95ce-4508-b923-003b5c2cae7f tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:36.419221 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-593a7e3b-95ce-4508-b923-003b5c2cae7f tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:36.456075 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-5f8cb905-28fc-4272-b9fe-0a31106da64a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:36.462040 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-5f8cb905-28fc-4272-b9fe-0a31106da64a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: ab871db0-6362-4dd3-b29c-b513351e027b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:36.463225 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5f8cb905-28fc-4272-b9fe-0a31106da64a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:36.463715 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5f8cb905-28fc-4272-b9fe-0a31106da64a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:36.464182 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5f8cb905-28fc-4272-b9fe-0a31106da64a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:36.464874 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5f8cb905-28fc-4272-b9fe-0a31106da64a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:36.465334 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5f8cb905-28fc-4272-b9fe-0a31106da64a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:36.465757 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5f8cb905-28fc-4272-b9fe-0a31106da64a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:36.499369 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.objects.instance [None req-593a7e3b-95ce-4508-b923-003b5c2cae7f tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lazy-loading 'services' on Instance uuid 703afaf7-e5a4-486b-a781-4bd2e3b06981 {{(pid=121232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 11:10:36.599078 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-5f8cb905-28fc-4272-b9fe-0a31106da64a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:36.608724 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-5f8cb905-28fc-4272-b9fe-0a31106da64a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:36.610834 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-5f8cb905-28fc-4272-b9fe-0a31106da64a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:36.612910 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-5f8cb905-28fc-4272-b9fe-0a31106da64a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b" status: 200 len: 1730 microversion: 2.20 time: 0.160126 Aug 11 11:10:36.613584 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 435/887] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:10:36 2022] GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 11:10:36.796218 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-593a7e3b-95ce-4508-b923-003b5c2cae7f tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "DELETE /compute/v2.1/servers/703afaf7-e5a4-486b-a781-4bd2e3b06981/os-volume_attachments/29a5da93-b076-4286-b9a2-11460a3547dd" status: 202 len: 0 microversion: 2.1 time: 0.390806 Aug 11 11:10:36.796795 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 453/888] 10.222.0.48 () {58 vars in 1416 bytes} [Thu Aug 11 11:10:36 2022] DELETE /compute/v2.1/servers/703afaf7-e5a4-486b-a781-4bd2e3b06981/os-volume_attachments/29a5da93-b076-4286-b9a2-11460a3547dd => generated 0 bytes in 392 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 11:10:37.003819 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-41f1e117-f3f3-43a1-9c09-565faedc0f96 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:37.008244 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-41f1e117-f3f3-43a1-9c09-565faedc0f96 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] [instance: 9c9f7edb-2175-4575-ac11-781015e25a57] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:37.011752 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-41f1e117-f3f3-43a1-9c09-565faedc0f96 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:37.012477 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-41f1e117-f3f3-43a1-9c09-565faedc0f96 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:37.013538 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-41f1e117-f3f3-43a1-9c09-565faedc0f96 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:37.013860 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-41f1e117-f3f3-43a1-9c09-565faedc0f96 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:37.014318 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-41f1e117-f3f3-43a1-9c09-565faedc0f96 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:37.014912 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-41f1e117-f3f3-43a1-9c09-565faedc0f96 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:37.149413 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-41f1e117-f3f3-43a1-9c09-565faedc0f96 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b2f7b56f6d94908bf00b3f21954776c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea40881648b4df393fc35c07d8f68dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:37.156978 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-41f1e117-f3f3-43a1-9c09-565faedc0f96 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] 10.222.0.48 "GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57" status: 200 len: 1260 microversion: 2.1 time: 0.157199 Aug 11 11:10:37.157552 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 436/889] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:10:36 2022] GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:10:37.638647 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-0c2d8c66-f1bd-405f-828d-5b07eb291f84 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:37.639338 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-0c2d8c66-f1bd-405f-828d-5b07eb291f84 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: ab871db0-6362-4dd3-b29c-b513351e027b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:37.645535 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0c2d8c66-f1bd-405f-828d-5b07eb291f84 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:37.646021 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0c2d8c66-f1bd-405f-828d-5b07eb291f84 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:37.646454 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0c2d8c66-f1bd-405f-828d-5b07eb291f84 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:37.647136 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0c2d8c66-f1bd-405f-828d-5b07eb291f84 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:37.647584 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0c2d8c66-f1bd-405f-828d-5b07eb291f84 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:37.648038 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0c2d8c66-f1bd-405f-828d-5b07eb291f84 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:37.784421 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-0c2d8c66-f1bd-405f-828d-5b07eb291f84 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:37.792652 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-0c2d8c66-f1bd-405f-828d-5b07eb291f84 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:37.794167 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-0c2d8c66-f1bd-405f-828d-5b07eb291f84 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:37.795321 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-0c2d8c66-f1bd-405f-828d-5b07eb291f84 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b" status: 200 len: 1730 microversion: 2.20 time: 0.162343 Aug 11 11:10:37.795903 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 454/890] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:10:37 2022] GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:10:38.179383 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-f69ccd69-2ad3-442c-9d04-3204a7dd7d53 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:38.180061 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-f69ccd69-2ad3-442c-9d04-3204a7dd7d53 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] [instance: 9c9f7edb-2175-4575-ac11-781015e25a57] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:38.187893 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f69ccd69-2ad3-442c-9d04-3204a7dd7d53 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:38.188866 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f69ccd69-2ad3-442c-9d04-3204a7dd7d53 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:38.188866 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f69ccd69-2ad3-442c-9d04-3204a7dd7d53 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:38.189478 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f69ccd69-2ad3-442c-9d04-3204a7dd7d53 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:38.189938 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f69ccd69-2ad3-442c-9d04-3204a7dd7d53 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:38.190364 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f69ccd69-2ad3-442c-9d04-3204a7dd7d53 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:38.322315 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-f69ccd69-2ad3-442c-9d04-3204a7dd7d53 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b2f7b56f6d94908bf00b3f21954776c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea40881648b4df393fc35c07d8f68dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:38.324547 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell1:SELECT=100 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:10:38.330522 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-f69ccd69-2ad3-442c-9d04-3204a7dd7d53 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] 10.222.0.48 "GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57" status: 200 len: 1260 microversion: 2.1 time: 0.155576 Aug 11 11:10:38.332203 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 437/891] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:10:38 2022] GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:10:38.665874 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-c828b90c-f1f0-4883-9a0d-f27e401093b0 req-b65b6214-8fc6-45aa-96a2-781acac5da38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c9f7edb-2175-4575-ac11-781015e25a57", "name": "network-vif-plugged", "status": "completed", "tag": "c6b87a06-7611-406e-8113-f1a3bada6e72"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:10:38.674584 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-c828b90c-f1f0-4883-9a0d-f27e401093b0 req-b65b6214-8fc6-45aa-96a2-781acac5da38 service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:38.675060 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-c828b90c-f1f0-4883-9a0d-f27e401093b0 req-b65b6214-8fc6-45aa-96a2-781acac5da38 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:38.675484 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-c828b90c-f1f0-4883-9a0d-f27e401093b0 req-b65b6214-8fc6-45aa-96a2-781acac5da38 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:38.687015 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-c828b90c-f1f0-4883-9a0d-f27e401093b0 req-b65b6214-8fc6-45aa-96a2-781acac5da38 service nova] Creating event network-vif-plugged:c6b87a06-7611-406e-8113-f1a3bada6e72 for instance 9c9f7edb-2175-4575-ac11-781015e25a57 on hv-cinder-82002 Aug 11 11:10:38.691672 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-c828b90c-f1f0-4883-9a0d-f27e401093b0 req-b65b6214-8fc6-45aa-96a2-781acac5da38 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032105 Aug 11 11:10:38.692280 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 455/892] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:10:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:10:38.817994 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-dcd4ad12-f3ad-4b21-9053-aababa4eabf4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:38.818685 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-dcd4ad12-f3ad-4b21-9053-aababa4eabf4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: ab871db0-6362-4dd3-b29c-b513351e027b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:38.825389 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-dcd4ad12-f3ad-4b21-9053-aababa4eabf4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:38.826152 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-dcd4ad12-f3ad-4b21-9053-aababa4eabf4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:38.826786 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-dcd4ad12-f3ad-4b21-9053-aababa4eabf4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:38.827648 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-dcd4ad12-f3ad-4b21-9053-aababa4eabf4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:38.828285 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-dcd4ad12-f3ad-4b21-9053-aababa4eabf4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:38.828700 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-dcd4ad12-f3ad-4b21-9053-aababa4eabf4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:38.980428 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-dcd4ad12-f3ad-4b21-9053-aababa4eabf4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:38.983888 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-6e3c6786-2465-46c6-808d-005ef47acf2c tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:38.984537 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-6e3c6786-2465-46c6-808d-005ef47acf2c tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 703afaf7-e5a4-486b-a781-4bd2e3b06981] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:38.994894 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6e3c6786-2465-46c6-808d-005ef47acf2c tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:38.995097 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6e3c6786-2465-46c6-808d-005ef47acf2c tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:38.995978 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6e3c6786-2465-46c6-808d-005ef47acf2c tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:38.996699 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6e3c6786-2465-46c6-808d-005ef47acf2c tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:38.997490 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6e3c6786-2465-46c6-808d-005ef47acf2c tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:38.997930 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6e3c6786-2465-46c6-808d-005ef47acf2c tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:39.005693 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-dcd4ad12-f3ad-4b21-9053-aababa4eabf4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:39.007693 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-dcd4ad12-f3ad-4b21-9053-aababa4eabf4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:39.009007 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-dcd4ad12-f3ad-4b21-9053-aababa4eabf4 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b" status: 200 len: 1730 microversion: 2.20 time: 0.195042 Aug 11 11:10:39.009677 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 438/893] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:10:38 2022] GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b => generated 1730 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:10:39.041082 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-6e3c6786-2465-46c6-808d-005ef47acf2c tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/703afaf7-e5a4-486b-a781-4bd2e3b06981/os-volume_attachments/b8bff282-e1ea-4786-a117-cdff73a5711b" status: 200 len: 194 microversion: 2.1 time: 0.062309 Aug 11 11:10:39.041852 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 456/894] 10.222.0.48 () {58 vars in 1413 bytes} [Thu Aug 11 11:10:38 2022] GET /compute/v2.1/servers/703afaf7-e5a4-486b-a781-4bd2e3b06981/os-volume_attachments/b8bff282-e1ea-4786-a117-cdff73a5711b => generated 194 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:10:39.052428 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-d3294b0b-81b3-4fa7-8da7-34052b2e765c tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:39.052944 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-d3294b0b-81b3-4fa7-8da7-34052b2e765c tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 703afaf7-e5a4-486b-a781-4bd2e3b06981] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:39.059287 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d3294b0b-81b3-4fa7-8da7-34052b2e765c tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:39.059861 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d3294b0b-81b3-4fa7-8da7-34052b2e765c tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:39.060299 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d3294b0b-81b3-4fa7-8da7-34052b2e765c tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:39.060990 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d3294b0b-81b3-4fa7-8da7-34052b2e765c tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:39.061440 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d3294b0b-81b3-4fa7-8da7-34052b2e765c tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:39.061857 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d3294b0b-81b3-4fa7-8da7-34052b2e765c tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:39.141670 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.objects.instance [None req-d3294b0b-81b3-4fa7-8da7-34052b2e765c tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lazy-loading 'services' on Instance uuid 703afaf7-e5a4-486b-a781-4bd2e3b06981 {{(pid=121231) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 11:10:39.350447 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-6b176dd3-d435-469a-a414-9706c488b6d2 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:39.351109 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-6b176dd3-d435-469a-a414-9706c488b6d2 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] [instance: 9c9f7edb-2175-4575-ac11-781015e25a57] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:39.357142 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6b176dd3-d435-469a-a414-9706c488b6d2 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:39.357617 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6b176dd3-d435-469a-a414-9706c488b6d2 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:39.358051 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6b176dd3-d435-469a-a414-9706c488b6d2 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:39.358725 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6b176dd3-d435-469a-a414-9706c488b6d2 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:39.359203 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6b176dd3-d435-469a-a414-9706c488b6d2 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:39.359619 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6b176dd3-d435-469a-a414-9706c488b6d2 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:39.390141 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-d3294b0b-81b3-4fa7-8da7-34052b2e765c tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "DELETE /compute/v2.1/servers/703afaf7-e5a4-486b-a781-4bd2e3b06981/os-volume_attachments/b8bff282-e1ea-4786-a117-cdff73a5711b" status: 202 len: 0 microversion: 2.1 time: 0.341665 Aug 11 11:10:39.390827 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 439/895] 10.222.0.48 () {58 vars in 1416 bytes} [Thu Aug 11 11:10:39 2022] DELETE /compute/v2.1/servers/703afaf7-e5a4-486b-a781-4bd2e3b06981/os-volume_attachments/b8bff282-e1ea-4786-a117-cdff73a5711b => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 11 11:10:39.502306 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-6b176dd3-d435-469a-a414-9706c488b6d2 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b2f7b56f6d94908bf00b3f21954776c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea40881648b4df393fc35c07d8f68dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:39.510314 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-6b176dd3-d435-469a-a414-9706c488b6d2 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] 10.222.0.48 "GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57" status: 200 len: 1260 microversion: 2.1 time: 0.163732 Aug 11 11:10:39.510862 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 457/896] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:10:39 2022] GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57 => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:10:40.033238 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-7d01a917-8e31-42f2-92b4-ec9df3db583a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:40.033935 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-7d01a917-8e31-42f2-92b4-ec9df3db583a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: ab871db0-6362-4dd3-b29c-b513351e027b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:40.040902 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7d01a917-8e31-42f2-92b4-ec9df3db583a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:40.041337 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7d01a917-8e31-42f2-92b4-ec9df3db583a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:40.041811 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7d01a917-8e31-42f2-92b4-ec9df3db583a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:40.042499 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7d01a917-8e31-42f2-92b4-ec9df3db583a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:40.042950 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7d01a917-8e31-42f2-92b4-ec9df3db583a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:40.043369 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7d01a917-8e31-42f2-92b4-ec9df3db583a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:40.170875 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-7d01a917-8e31-42f2-92b4-ec9df3db583a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:40.178761 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-7d01a917-8e31-42f2-92b4-ec9df3db583a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:40.180317 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-7d01a917-8e31-42f2-92b4-ec9df3db583a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:40.182090 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-7d01a917-8e31-42f2-92b4-ec9df3db583a tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b" status: 200 len: 1730 microversion: 2.20 time: 0.153127 Aug 11 11:10:40.182646 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 440/897] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:10:40 2022] GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:10:40.531346 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-e6b83494-bb1e-4e6b-9568-ffe263354e09 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:40.531991 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-e6b83494-bb1e-4e6b-9568-ffe263354e09 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] [instance: 9c9f7edb-2175-4575-ac11-781015e25a57] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:40.538359 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e6b83494-bb1e-4e6b-9568-ffe263354e09 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:40.538833 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e6b83494-bb1e-4e6b-9568-ffe263354e09 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:40.539260 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e6b83494-bb1e-4e6b-9568-ffe263354e09 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:40.540306 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e6b83494-bb1e-4e6b-9568-ffe263354e09 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:40.541272 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e6b83494-bb1e-4e6b-9568-ffe263354e09 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:40.541682 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e6b83494-bb1e-4e6b-9568-ffe263354e09 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:40.707607 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-b4cd9f65-23d0-43bc-bfd7-74e826b8bc15 req-a44cef5f-3608-403e-931c-da07c38d7021 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab871db0-6362-4dd3-b29c-b513351e027b", "name": "network-vif-plugged", "status": "completed", "tag": "1f4049ad-be47-41fe-a43f-26460abf19d8"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:10:40.718690 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-b4cd9f65-23d0-43bc-bfd7-74e826b8bc15 req-a44cef5f-3608-403e-931c-da07c38d7021 service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:40.719169 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-b4cd9f65-23d0-43bc-bfd7-74e826b8bc15 req-a44cef5f-3608-403e-931c-da07c38d7021 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:40.719600 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-b4cd9f65-23d0-43bc-bfd7-74e826b8bc15 req-a44cef5f-3608-403e-931c-da07c38d7021 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:40.731575 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-b4cd9f65-23d0-43bc-bfd7-74e826b8bc15 req-a44cef5f-3608-403e-931c-da07c38d7021 service nova] Creating event network-vif-plugged:1f4049ad-be47-41fe-a43f-26460abf19d8 for instance ab871db0-6362-4dd3-b29c-b513351e027b on hv-cinder-82002 Aug 11 11:10:40.737364 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-b4cd9f65-23d0-43bc-bfd7-74e826b8bc15 req-a44cef5f-3608-403e-931c-da07c38d7021 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033028 Aug 11 11:10:40.737909 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 441/898] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:10:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 11:10:40.908659 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-e6b83494-bb1e-4e6b-9568-ffe263354e09 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b2f7b56f6d94908bf00b3f21954776c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea40881648b4df393fc35c07d8f68dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:40.916364 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-e6b83494-bb1e-4e6b-9568-ffe263354e09 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] 10.222.0.48 "GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57" status: 200 len: 1260 microversion: 2.1 time: 0.388891 Aug 11 11:10:40.916922 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 458/899] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:10:40 2022] GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57 => generated 1260 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:10:41.205329 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-56a27238-4c24-4fed-bea7-eac2e93eee64 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:41.206018 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-56a27238-4c24-4fed-bea7-eac2e93eee64 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: ab871db0-6362-4dd3-b29c-b513351e027b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:41.212371 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-56a27238-4c24-4fed-bea7-eac2e93eee64 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:41.212862 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-56a27238-4c24-4fed-bea7-eac2e93eee64 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:41.213292 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-56a27238-4c24-4fed-bea7-eac2e93eee64 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:41.213966 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-56a27238-4c24-4fed-bea7-eac2e93eee64 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:41.214415 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-56a27238-4c24-4fed-bea7-eac2e93eee64 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:41.214832 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-56a27238-4c24-4fed-bea7-eac2e93eee64 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:41.342684 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-56a27238-4c24-4fed-bea7-eac2e93eee64 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:41.350649 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-56a27238-4c24-4fed-bea7-eac2e93eee64 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:41.352227 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-56a27238-4c24-4fed-bea7-eac2e93eee64 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:41.353889 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-56a27238-4c24-4fed-bea7-eac2e93eee64 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b" status: 200 len: 1730 microversion: 2.20 time: 0.152984 Aug 11 11:10:41.354438 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 442/900] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:10:41 2022] GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:10:41.620598 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-d1cea269-08a3-414e-a5d0-b9c12f94b7cf tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:41.622764 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-d1cea269-08a3-414e-a5d0-b9c12f94b7cf tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 703afaf7-e5a4-486b-a781-4bd2e3b06981] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:41.629140 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d1cea269-08a3-414e-a5d0-b9c12f94b7cf tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:41.629613 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d1cea269-08a3-414e-a5d0-b9c12f94b7cf tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:41.630040 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d1cea269-08a3-414e-a5d0-b9c12f94b7cf tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:41.630714 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d1cea269-08a3-414e-a5d0-b9c12f94b7cf tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:41.631156 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d1cea269-08a3-414e-a5d0-b9c12f94b7cf tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:41.631580 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d1cea269-08a3-414e-a5d0-b9c12f94b7cf tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:41.661902 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-d1cea269-08a3-414e-a5d0-b9c12f94b7cf tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/703afaf7-e5a4-486b-a781-4bd2e3b06981/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046158 Aug 11 11:10:41.662461 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 459/901] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Aug 11 11:10:41 2022] GET /compute/v2.1/servers/703afaf7-e5a4-486b-a781-4bd2e3b06981/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:10:41.938061 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-7101c498-a6f3-4b9b-a1b2-2e08da342b01 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:41.938667 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-7101c498-a6f3-4b9b-a1b2-2e08da342b01 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] [instance: 9c9f7edb-2175-4575-ac11-781015e25a57] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:41.945279 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7101c498-a6f3-4b9b-a1b2-2e08da342b01 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:41.945764 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7101c498-a6f3-4b9b-a1b2-2e08da342b01 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:41.946189 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7101c498-a6f3-4b9b-a1b2-2e08da342b01 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:41.946879 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7101c498-a6f3-4b9b-a1b2-2e08da342b01 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:41.947455 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7101c498-a6f3-4b9b-a1b2-2e08da342b01 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:41.947910 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7101c498-a6f3-4b9b-a1b2-2e08da342b01 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:42.083042 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-7101c498-a6f3-4b9b-a1b2-2e08da342b01 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b2f7b56f6d94908bf00b3f21954776c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea40881648b4df393fc35c07d8f68dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:42.090533 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-7101c498-a6f3-4b9b-a1b2-2e08da342b01 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] 10.222.0.48 "GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57" status: 200 len: 1443 microversion: 2.1 time: 0.156510 Aug 11 11:10:42.091089 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 443/902] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:10:41 2022] GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57 => generated 1443 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:10:42.116842 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-b05e7bf2-86be-45fc-b367-4ed19816dc0d tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:42.117545 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-b05e7bf2-86be-45fc-b367-4ed19816dc0d tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] [instance: 9c9f7edb-2175-4575-ac11-781015e25a57] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:42.124212 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b05e7bf2-86be-45fc-b367-4ed19816dc0d tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:42.124692 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b05e7bf2-86be-45fc-b367-4ed19816dc0d tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:42.125112 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b05e7bf2-86be-45fc-b367-4ed19816dc0d tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:42.125797 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b05e7bf2-86be-45fc-b367-4ed19816dc0d tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:42.126239 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b05e7bf2-86be-45fc-b367-4ed19816dc0d tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:42.126652 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b05e7bf2-86be-45fc-b367-4ed19816dc0d tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:42.260713 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-b05e7bf2-86be-45fc-b367-4ed19816dc0d tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b2f7b56f6d94908bf00b3f21954776c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea40881648b4df393fc35c07d8f68dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:42.268461 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-b05e7bf2-86be-45fc-b367-4ed19816dc0d tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] 10.222.0.48 "GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57" status: 200 len: 1443 microversion: 2.1 time: 0.155763 Aug 11 11:10:42.269027 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 460/903] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:10:42 2022] GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57 => generated 1443 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:10:42.377023 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-99d22c70-7c69-4df9-b950-389663567d8d tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:42.377642 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-99d22c70-7c69-4df9-b950-389663567d8d tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: ab871db0-6362-4dd3-b29c-b513351e027b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:42.384180 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-99d22c70-7c69-4df9-b950-389663567d8d tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:42.384682 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-99d22c70-7c69-4df9-b950-389663567d8d tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:42.385124 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-99d22c70-7c69-4df9-b950-389663567d8d tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:42.385831 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-99d22c70-7c69-4df9-b950-389663567d8d tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:42.386287 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-99d22c70-7c69-4df9-b950-389663567d8d tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:42.386715 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-99d22c70-7c69-4df9-b950-389663567d8d tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:42.527366 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-99d22c70-7c69-4df9-b950-389663567d8d tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:42.535570 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-99d22c70-7c69-4df9-b950-389663567d8d tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:42.537107 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-99d22c70-7c69-4df9-b950-389663567d8d tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:42.538265 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-99d22c70-7c69-4df9-b950-389663567d8d tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b" status: 200 len: 1730 microversion: 2.20 time: 0.165666 Aug 11 11:10:42.538821 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 444/904] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:10:42 2022] GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:10:42.674969 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-3afdff9c-7cde-423e-889f-1d4f55f5db0d tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:42.677139 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-3afdff9c-7cde-423e-889f-1d4f55f5db0d tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 703afaf7-e5a4-486b-a781-4bd2e3b06981] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:42.683735 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3afdff9c-7cde-423e-889f-1d4f55f5db0d tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:42.684254 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3afdff9c-7cde-423e-889f-1d4f55f5db0d tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:42.684729 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3afdff9c-7cde-423e-889f-1d4f55f5db0d tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:42.685433 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3afdff9c-7cde-423e-889f-1d4f55f5db0d tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:42.685888 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3afdff9c-7cde-423e-889f-1d4f55f5db0d tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:42.686333 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3afdff9c-7cde-423e-889f-1d4f55f5db0d tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:42.715655 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-3afdff9c-7cde-423e-889f-1d4f55f5db0d tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/703afaf7-e5a4-486b-a781-4bd2e3b06981/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044664 Aug 11 11:10:42.716762 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 461/905] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Aug 11 11:10:42 2022] GET /compute/v2.1/servers/703afaf7-e5a4-486b-a781-4bd2e3b06981/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 11 11:10:42.838020 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-564b6caa-9a12-4995-b35f-1d6ffd913e40 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:42.840248 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-564b6caa-9a12-4995-b35f-1d6ffd913e40 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 703afaf7-e5a4-486b-a781-4bd2e3b06981] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:42.846387 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-564b6caa-9a12-4995-b35f-1d6ffd913e40 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:42.846872 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-564b6caa-9a12-4995-b35f-1d6ffd913e40 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:42.847312 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-564b6caa-9a12-4995-b35f-1d6ffd913e40 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:42.848034 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-564b6caa-9a12-4995-b35f-1d6ffd913e40 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:42.848487 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-564b6caa-9a12-4995-b35f-1d6ffd913e40 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:42.848908 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-564b6caa-9a12-4995-b35f-1d6ffd913e40 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:42.878349 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-564b6caa-9a12-4995-b35f-1d6ffd913e40 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/703afaf7-e5a4-486b-a781-4bd2e3b06981/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044851 Aug 11 11:10:42.879432 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 445/906] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Aug 11 11:10:42 2022] GET /compute/v2.1/servers/703afaf7-e5a4-486b-a781-4bd2e3b06981/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 11 11:10:42.941942 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-88da0937-a84d-4437-85ef-947b852b82f1 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:42.942436 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-88da0937-a84d-4437-85ef-947b852b82f1 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 703afaf7-e5a4-486b-a781-4bd2e3b06981] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:42.949005 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-88da0937-a84d-4437-85ef-947b852b82f1 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:42.952075 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-88da0937-a84d-4437-85ef-947b852b82f1 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:42.952075 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-88da0937-a84d-4437-85ef-947b852b82f1 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:42.952075 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-88da0937-a84d-4437-85ef-947b852b82f1 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:42.952075 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-88da0937-a84d-4437-85ef-947b852b82f1 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:42.952464 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-88da0937-a84d-4437-85ef-947b852b82f1 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:42.980927 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-88da0937-a84d-4437-85ef-947b852b82f1 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 703afaf7-e5a4-486b-a781-4bd2e3b06981] Going to try to terminate instance {{(pid=121232) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 11 11:10:42.980927 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:10:43.310883 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-88da0937-a84d-4437-85ef-947b852b82f1 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "DELETE /compute/v2.1/servers/703afaf7-e5a4-486b-a781-4bd2e3b06981" status: 204 len: 0 microversion: 2.1 time: 0.372393 Aug 11 11:10:43.311490 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 462/907] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Aug 11 11:10:42 2022] DELETE /compute/v2.1/servers/703afaf7-e5a4-486b-a781-4bd2e3b06981 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 11 11:10:43.319728 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-1abffc23-4cc8-4470-aedd-822d505fd2d0 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:43.320363 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-1abffc23-4cc8-4470-aedd-822d505fd2d0 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 703afaf7-e5a4-486b-a781-4bd2e3b06981] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:43.327698 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1abffc23-4cc8-4470-aedd-822d505fd2d0 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:43.329728 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1abffc23-4cc8-4470-aedd-822d505fd2d0 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:43.329728 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1abffc23-4cc8-4470-aedd-822d505fd2d0 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:43.329728 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1abffc23-4cc8-4470-aedd-822d505fd2d0 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:43.330015 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1abffc23-4cc8-4470-aedd-822d505fd2d0 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:43.330325 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1abffc23-4cc8-4470-aedd-822d505fd2d0 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:43.465577 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-1abffc23-4cc8-4470-aedd-822d505fd2d0 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:43.473334 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-1abffc23-4cc8-4470-aedd-822d505fd2d0 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/703afaf7-e5a4-486b-a781-4bd2e3b06981" status: 200 len: 1674 microversion: 2.1 time: 0.157448 Aug 11 11:10:43.473905 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 446/908] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:10:43 2022] GET /compute/v2.1/servers/703afaf7-e5a4-486b-a781-4bd2e3b06981 => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:10:43.562136 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-7ca3da77-b4bc-4211-9710-91b6e346b82e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:43.562834 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-7ca3da77-b4bc-4211-9710-91b6e346b82e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: ab871db0-6362-4dd3-b29c-b513351e027b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:43.568726 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7ca3da77-b4bc-4211-9710-91b6e346b82e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:43.570683 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7ca3da77-b4bc-4211-9710-91b6e346b82e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:43.570683 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7ca3da77-b4bc-4211-9710-91b6e346b82e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:43.570683 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7ca3da77-b4bc-4211-9710-91b6e346b82e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:43.570977 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7ca3da77-b4bc-4211-9710-91b6e346b82e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:43.571226 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7ca3da77-b4bc-4211-9710-91b6e346b82e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:43.713773 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-7ca3da77-b4bc-4211-9710-91b6e346b82e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:43.723188 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-7ca3da77-b4bc-4211-9710-91b6e346b82e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:43.724806 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-7ca3da77-b4bc-4211-9710-91b6e346b82e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:43.726614 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-7ca3da77-b4bc-4211-9710-91b6e346b82e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b" status: 200 len: 1730 microversion: 2.20 time: 0.168342 Aug 11 11:10:43.729871 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 463/909] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:10:43 2022] GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:10:44.494901 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-efa8e9c7-660c-451a-9d70-aabd308bfb90 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:44.495618 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-efa8e9c7-660c-451a-9d70-aabd308bfb90 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 703afaf7-e5a4-486b-a781-4bd2e3b06981] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:44.504471 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-efa8e9c7-660c-451a-9d70-aabd308bfb90 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:44.504983 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-efa8e9c7-660c-451a-9d70-aabd308bfb90 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:44.505417 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-efa8e9c7-660c-451a-9d70-aabd308bfb90 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:44.506158 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-efa8e9c7-660c-451a-9d70-aabd308bfb90 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:44.511814 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-06c9165b-fc81-4740-8f87-c0799813b265 req-9ba2765f-d87f-4c62-8672-894c08f5b1a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c9f7edb-2175-4575-ac11-781015e25a57", "tag": "c6b87a06-7611-406e-8113-f1a3bada6e72"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:10:44.516345 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-efa8e9c7-660c-451a-9d70-aabd308bfb90 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:44.516777 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-efa8e9c7-660c-451a-9d70-aabd308bfb90 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:44.526246 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-06c9165b-fc81-4740-8f87-c0799813b265 req-9ba2765f-d87f-4c62-8672-894c08f5b1a1 service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:44.527289 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-06c9165b-fc81-4740-8f87-c0799813b265 req-9ba2765f-d87f-4c62-8672-894c08f5b1a1 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:44.527841 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-06c9165b-fc81-4740-8f87-c0799813b265 req-9ba2765f-d87f-4c62-8672-894c08f5b1a1 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:44.539086 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-06c9165b-fc81-4740-8f87-c0799813b265 req-9ba2765f-d87f-4c62-8672-894c08f5b1a1 service nova] Creating event network-changed:c6b87a06-7611-406e-8113-f1a3bada6e72 for instance 9c9f7edb-2175-4575-ac11-781015e25a57 on hv-cinder-82002 Aug 11 11:10:44.544224 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-06c9165b-fc81-4740-8f87-c0799813b265 req-9ba2765f-d87f-4c62-8672-894c08f5b1a1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036563 Aug 11 11:10:44.544820 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 464/910] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:10:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:10:44.667785 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-efa8e9c7-660c-451a-9d70-aabd308bfb90 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:44.675399 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-efa8e9c7-660c-451a-9d70-aabd308bfb90 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/703afaf7-e5a4-486b-a781-4bd2e3b06981" status: 200 len: 1674 microversion: 2.1 time: 0.184737 Aug 11 11:10:44.675973 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 447/911] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:10:44 2022] GET /compute/v2.1/servers/703afaf7-e5a4-486b-a781-4bd2e3b06981 => generated 1674 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:10:44.750990 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-decf872c-a2d4-430b-aeea-9bb58dd3b040 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:44.751689 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-decf872c-a2d4-430b-aeea-9bb58dd3b040 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: ab871db0-6362-4dd3-b29c-b513351e027b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:44.757819 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-decf872c-a2d4-430b-aeea-9bb58dd3b040 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:44.758297 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-decf872c-a2d4-430b-aeea-9bb58dd3b040 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:44.759287 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-decf872c-a2d4-430b-aeea-9bb58dd3b040 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:44.760001 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-decf872c-a2d4-430b-aeea-9bb58dd3b040 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:44.760561 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-decf872c-a2d4-430b-aeea-9bb58dd3b040 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:44.761328 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-decf872c-a2d4-430b-aeea-9bb58dd3b040 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:44.804885 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-1e92f215-741e-4286-8a68-d14aa4c840fa tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:44.805901 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-1e92f215-741e-4286-8a68-d14aa4c840fa tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: f6bf35b3-de6a-41ae-81b7-8f45852ab5e2] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:44.812283 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1e92f215-741e-4286-8a68-d14aa4c840fa tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:44.812991 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1e92f215-741e-4286-8a68-d14aa4c840fa tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:44.813420 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1e92f215-741e-4286-8a68-d14aa4c840fa tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:44.814288 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1e92f215-741e-4286-8a68-d14aa4c840fa tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:44.814738 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1e92f215-741e-4286-8a68-d14aa4c840fa tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:44.815167 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1e92f215-741e-4286-8a68-d14aa4c840fa tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:44.838883 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-1e92f215-741e-4286-8a68-d14aa4c840fa tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/f6bf35b3-de6a-41ae-81b7-8f45852ab5e2/ips" status: 200 len: 149 microversion: 2.1 time: 0.037922 Aug 11 11:10:44.839736 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 448/912] 10.222.0.48 () {58 vars in 1248 bytes} [Thu Aug 11 11:10:44 2022] GET /compute/v2.1/servers/f6bf35b3-de6a-41ae-81b7-8f45852ab5e2/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 11:10:44.899198 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-decf872c-a2d4-430b-aeea-9bb58dd3b040 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:44.908920 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-decf872c-a2d4-430b-aeea-9bb58dd3b040 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:44.911151 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-decf872c-a2d4-430b-aeea-9bb58dd3b040 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:44.912811 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-decf872c-a2d4-430b-aeea-9bb58dd3b040 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b" status: 200 len: 1730 microversion: 2.20 time: 0.166702 Aug 11 11:10:44.913791 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 465/913] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:10:44 2022] GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:10:45.696118 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-99bf5186-46cc-44f6-9f28-80e3a837aaa7 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:45.720379 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-99bf5186-46cc-44f6-9f28-80e3a837aaa7 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 703afaf7-e5a4-486b-a781-4bd2e3b06981] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:45.720379 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-99bf5186-46cc-44f6-9f28-80e3a837aaa7 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:45.720379 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-99bf5186-46cc-44f6-9f28-80e3a837aaa7 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:45.720379 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-99bf5186-46cc-44f6-9f28-80e3a837aaa7 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:45.721521 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-99bf5186-46cc-44f6-9f28-80e3a837aaa7 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:45.721521 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-99bf5186-46cc-44f6-9f28-80e3a837aaa7 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:45.721521 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-99bf5186-46cc-44f6-9f28-80e3a837aaa7 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:45.938287 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-99bf5186-46cc-44f6-9f28-80e3a837aaa7 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:45.941242 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-100ca160-97c8-4c28-84d1-56b2eef22fe5 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:45.941850 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-100ca160-97c8-4c28-84d1-56b2eef22fe5 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: ab871db0-6362-4dd3-b29c-b513351e027b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:45.943724 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-99bf5186-46cc-44f6-9f28-80e3a837aaa7 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/703afaf7-e5a4-486b-a781-4bd2e3b06981" status: 200 len: 1674 microversion: 2.1 time: 0.251558 Aug 11 11:10:45.949892 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-100ca160-97c8-4c28-84d1-56b2eef22fe5 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:45.950374 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-100ca160-97c8-4c28-84d1-56b2eef22fe5 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:45.950811 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-100ca160-97c8-4c28-84d1-56b2eef22fe5 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:45.951516 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-100ca160-97c8-4c28-84d1-56b2eef22fe5 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:45.952005 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-100ca160-97c8-4c28-84d1-56b2eef22fe5 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:45.952614 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-100ca160-97c8-4c28-84d1-56b2eef22fe5 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:45.958645 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 449/914] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:10:45 2022] GET /compute/v2.1/servers/703afaf7-e5a4-486b-a781-4bd2e3b06981 => generated 1674 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:10:46.103522 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-100ca160-97c8-4c28-84d1-56b2eef22fe5 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:46.111612 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-100ca160-97c8-4c28-84d1-56b2eef22fe5 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:46.113141 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-100ca160-97c8-4c28-84d1-56b2eef22fe5 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:46.117214 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-100ca160-97c8-4c28-84d1-56b2eef22fe5 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b" status: 200 len: 1717 microversion: 2.20 time: 0.178321 Aug 11 11:10:46.117214 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 466/915] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:10:45 2022] GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b => generated 1717 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 11 11:10:46.448015 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-ca3fa684-ba86-462a-b5f0-ad18511e5652 req-c2f1908c-dfdb-44d8-bd40-b8a1416226ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "703afaf7-e5a4-486b-a781-4bd2e3b06981", "name": "network-vif-deleted", "tag": "03264dbf-1d91-494b-b399-8a502d9530a4"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:10:46.457900 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-ca3fa684-ba86-462a-b5f0-ad18511e5652 req-c2f1908c-dfdb-44d8-bd40-b8a1416226ee service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:46.458375 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-ca3fa684-ba86-462a-b5f0-ad18511e5652 req-c2f1908c-dfdb-44d8-bd40-b8a1416226ee service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:46.458796 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-ca3fa684-ba86-462a-b5f0-ad18511e5652 req-c2f1908c-dfdb-44d8-bd40-b8a1416226ee service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:46.470087 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-ca3fa684-ba86-462a-b5f0-ad18511e5652 req-c2f1908c-dfdb-44d8-bd40-b8a1416226ee service nova] Creating event network-vif-deleted:03264dbf-1d91-494b-b399-8a502d9530a4 for instance 703afaf7-e5a4-486b-a781-4bd2e3b06981 on hv-cinder-82002 Aug 11 11:10:46.474909 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-ca3fa684-ba86-462a-b5f0-ad18511e5652 req-c2f1908c-dfdb-44d8-bd40-b8a1416226ee service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031175 Aug 11 11:10:46.475491 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 450/916] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:10:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:10:46.674577 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-2200a5cf-3805-43bd-9510-588bde13d7c6 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d4cc7e22-b71a-4add-958c-8af923db7fa5"}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:10:46.677327 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-2200a5cf-3805-43bd-9510-588bde13d7c6 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: f6bf35b3-de6a-41ae-81b7-8f45852ab5e2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:46.689945 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2200a5cf-3805-43bd-9510-588bde13d7c6 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:46.690843 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2200a5cf-3805-43bd-9510-588bde13d7c6 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:46.691351 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2200a5cf-3805-43bd-9510-588bde13d7c6 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:46.692107 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2200a5cf-3805-43bd-9510-588bde13d7c6 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:46.692565 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2200a5cf-3805-43bd-9510-588bde13d7c6 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:46.692988 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2200a5cf-3805-43bd-9510-588bde13d7c6 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:46.967456 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-62a5d54b-4ca5-4524-865b-053ab6ed0980 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:46.968117 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-62a5d54b-4ca5-4524-865b-053ab6ed0980 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 703afaf7-e5a4-486b-a781-4bd2e3b06981] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:46.974686 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-62a5d54b-4ca5-4524-865b-053ab6ed0980 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:46.980058 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-62a5d54b-4ca5-4524-865b-053ab6ed0980 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:46.980058 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-62a5d54b-4ca5-4524-865b-053ab6ed0980 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:46.980058 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-62a5d54b-4ca5-4524-865b-053ab6ed0980 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:46.980058 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-62a5d54b-4ca5-4524-865b-053ab6ed0980 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:46.980508 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-62a5d54b-4ca5-4524-865b-053ab6ed0980 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:47.010770 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-62a5d54b-4ca5-4524-865b-053ab6ed0980 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:47.011260 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-62a5d54b-4ca5-4524-865b-053ab6ed0980 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:47.011697 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-62a5d54b-4ca5-4524-865b-053ab6ed0980 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:47.012182 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.objects.instance [None req-62a5d54b-4ca5-4524-865b-053ab6ed0980 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lazy-loading 'fault' on Instance uuid 703afaf7-e5a4-486b-a781-4bd2e3b06981 {{(pid=121231) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 11:10:47.062836 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-62a5d54b-4ca5-4524-865b-053ab6ed0980 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb18a00d44ed4af186bdc589e1e14e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b3799012d24fad98d155e3b000fc22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:47.070866 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-62a5d54b-4ca5-4524-865b-053ab6ed0980 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/703afaf7-e5a4-486b-a781-4bd2e3b06981" status: 200 len: 1327 microversion: 2.1 time: 0.108275 Aug 11 11:10:47.071442 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 451/917] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:10:46 2022] GET /compute/v2.1/servers/703afaf7-e5a4-486b-a781-4bd2e3b06981 => generated 1327 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:10:47.538572 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-2200a5cf-3805-43bd-9510-588bde13d7c6 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "POST /compute/v2.1/servers/f6bf35b3-de6a-41ae-81b7-8f45852ab5e2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.870158 Aug 11 11:10:47.540275 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 467/918] 10.222.0.48 () {60 vars in 1323 bytes} [Thu Aug 11 11:10:46 2022] POST /compute/v2.1/servers/f6bf35b3-de6a-41ae-81b7-8f45852ab5e2/os-volume_attachments => generated 194 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:10:48.091171 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-25ead4f4-ecab-4399-8b56-86e900fc3a35 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:48.091719 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-25ead4f4-ecab-4399-8b56-86e900fc3a35 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 703afaf7-e5a4-486b-a781-4bd2e3b06981] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:48.094119 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:10:48.098778 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-25ead4f4-ecab-4399-8b56-86e900fc3a35 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:48.099259 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-25ead4f4-ecab-4399-8b56-86e900fc3a35 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:48.099695 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-25ead4f4-ecab-4399-8b56-86e900fc3a35 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:48.100410 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-25ead4f4-ecab-4399-8b56-86e900fc3a35 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:48.100863 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-25ead4f4-ecab-4399-8b56-86e900fc3a35 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:48.101290 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-25ead4f4-ecab-4399-8b56-86e900fc3a35 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:48.114846 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.wsgi [None req-25ead4f4-ecab-4399-8b56-86e900fc3a35 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] HTTP exception thrown: Instance 703afaf7-e5a4-486b-a781-4bd2e3b06981 could not be found. Aug 11 11:10:48.116504 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-25ead4f4-ecab-4399-8b56-86e900fc3a35 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Request method failure captured: Aug 11 11:10:48.116504 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: request: GET /compute/v2.1/servers/703afaf7-e5a4-486b-a781-4bd2e3b06981 HTTP/1.1 Aug 11 11:10:48.116504 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Accept: application/json Aug 11 11:10:48.116504 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Accept-Encoding: identity Aug 11 11:10:48.116504 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Connection: close Aug 11 11:10:48.116504 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Content-Length: 0 Aug 11 11:10:48.116504 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Content-Type: application/json Aug 11 11:10:48.116504 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Host: 10.222.0.48 Aug 11 11:10:48.116504 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Openstack-System-Scope: None Aug 11 11:10:48.116504 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: User-Agent: python-urllib3/1.26.11 Aug 11 11:10:48.116504 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Auth-Token: gAAAAABi9OIRfnJpFtGQ5A6DGD3tzjjnbj8hoix-U8-zpHZo5hSEXhAqzDd8qOwUgjdkMuC_FgAY9kfkVldA2-CRi90KY2HEKbLPuClKRqK5ss7wuTuVTSkYcnzqSw74Y-caXwLJ1gamk4Xj2jETroJCKWaJM9wkh4X4EjWZZSdEmT48WtGyxTI Aug 11 11:10:48.116504 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Domain-Id: None Aug 11 11:10:48.116504 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Domain-Name: None Aug 11 11:10:48.116504 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Identity-Status: Confirmed Aug 11 11:10:48.116504 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Is-Admin-Project: True Aug 11 11:10:48.116504 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Domain-Id: default Aug 11 11:10:48.116504 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Domain-Name: Default Aug 11 11:10:48.116504 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Id: b0b3799012d24fad98d155e3b000fc22 Aug 11 11:10:48.116504 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Name: tempest-AttachVolumeTestJSON-1625266365 Aug 11 11:10:48.116504 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Role: reader,member Aug 11 11:10:48.116504 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Roles: reader,member Aug 11 11:10:48.118860 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b0b3799012d24fad98d155e3b000fc22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b0b3799012d24fad98d155e3b000fc22"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b0b3799012d24fad98d155e3b000fc22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b0b3799012d24fad98d155e3b000fc22", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] Aug 11 11:10:48.118860 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant: tempest-AttachVolumeTestJSON-1625266365 Aug 11 11:10:48.118860 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant-Id: b0b3799012d24fad98d155e3b000fc22 Aug 11 11:10:48.118860 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1625266365 Aug 11 11:10:48.118860 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User: tempest-AttachVolumeTestJSON-1625266365-project Aug 11 11:10:48.118860 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Domain-Id: default Aug 11 11:10:48.118860 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Domain-Name: Default Aug 11 11:10:48.118860 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Id: bb18a00d44ed4af186bdc589e1e14e22 Aug 11 11:10:48.118860 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Name: tempest-AttachVolumeTestJSON-1625266365-project Aug 11 11:10:48.118860 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: method: > Aug 11 11:10:48.118860 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: exception: Instance 703afaf7-e5a4-486b-a781-4bd2e3b06981 could not be found. Aug 11 11:10:48.118860 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: action_args: {'id': '703afaf7-e5a4-486b-a781-4bd2e3b06981'} Aug 11 11:10:48.119713 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 11:10:48.119713 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:10:48.119713 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 11:10:48.119713 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 11:10:48.119713 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 11:10:48.119713 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 11:10:48.119713 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 11:10:48.119713 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 11:10:48.119713 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 11:10:48.119713 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 11:10:48.119713 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 703afaf7-e5a4-486b-a781-4bd2e3b06981 could not be found. Aug 11 11:10:48.119713 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:10:48.119713 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:10:48.119713 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:10:48.119713 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:10:48.119713 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:10:48.119713 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:10:48.119713 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 11:10:48.119713 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 11:10:48.119713 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 11:10:48.121096 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 11:10:48.121096 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 11:10:48.121096 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 11:10:48.121096 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 11:10:48.121096 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 11:10:48.121096 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 11:10:48.121096 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 11:10:48.121096 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 703afaf7-e5a4-486b-a781-4bd2e3b06981 could not be found. Aug 11 11:10:48.121096 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:10:48.121096 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:10:48.121096 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:10:48.121096 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:10:48.121096 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:10:48.121096 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:10:48.121096 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 11:10:48.121096 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 11:10:48.121096 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 703afaf7-e5a4-486b-a781-4bd2e3b06981 could not be found. Aug 11 11:10:48.121096 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:10:48.122262 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-25ead4f4-ecab-4399-8b56-86e900fc3a35 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Returning 404 to user: Instance 703afaf7-e5a4-486b-a781-4bd2e3b06981 could not be found. {{(pid=121231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 11:10:48.122262 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-25ead4f4-ecab-4399-8b56-86e900fc3a35 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/703afaf7-e5a4-486b-a781-4bd2e3b06981" status: 404 len: 111 microversion: 2.1 time: 0.030755 Aug 11 11:10:48.122262 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 452/919] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:10:48 2022] GET /compute/v2.1/servers/703afaf7-e5a4-486b-a781-4bd2e3b06981 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 11:10:48.128548 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-cc954f41-6ed8-4390-9e8f-bd88ceaee1a2 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '.version_select at 0x7faab54f0310>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:48.135584 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:10:48.254847 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-cc954f41-6ed8-4390-9e8f-bd88ceaee1a2 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1544748498" status: 202 len: 0 microversion: 2.1 time: 0.130969 Aug 11 11:10:48.255431 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 468/920] 10.222.0.48 () {58 vars in 1221 bytes} [Thu Aug 11 11:10:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1544748498 => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 11:10:51.552970 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-36d618ca-f0f8-4623-8e07-0aed3fae16c4 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:51.553477 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-36d618ca-f0f8-4623-8e07-0aed3fae16c4 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 703afaf7-e5a4-486b-a781-4bd2e3b06981] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:51.561155 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-36d618ca-f0f8-4623-8e07-0aed3fae16c4 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:51.561633 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-36d618ca-f0f8-4623-8e07-0aed3fae16c4 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:51.562063 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-36d618ca-f0f8-4623-8e07-0aed3fae16c4 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:51.562743 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-36d618ca-f0f8-4623-8e07-0aed3fae16c4 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:51.563222 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-36d618ca-f0f8-4623-8e07-0aed3fae16c4 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:51.563645 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-36d618ca-f0f8-4623-8e07-0aed3fae16c4 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:51.577968 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.wsgi [None req-36d618ca-f0f8-4623-8e07-0aed3fae16c4 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] HTTP exception thrown: Instance 703afaf7-e5a4-486b-a781-4bd2e3b06981 could not be found. Aug 11 11:10:51.579499 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-36d618ca-f0f8-4623-8e07-0aed3fae16c4 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Request method failure captured: Aug 11 11:10:51.579499 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: request: DELETE /compute/v2.1/servers/703afaf7-e5a4-486b-a781-4bd2e3b06981 HTTP/1.1 Aug 11 11:10:51.579499 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Accept: application/json Aug 11 11:10:51.579499 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Accept-Encoding: identity Aug 11 11:10:51.579499 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Connection: close Aug 11 11:10:51.579499 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Content-Length: 0 Aug 11 11:10:51.579499 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Content-Type: application/json Aug 11 11:10:51.579499 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Host: 10.222.0.48 Aug 11 11:10:51.579499 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Openstack-System-Scope: None Aug 11 11:10:51.579499 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: User-Agent: python-urllib3/1.26.11 Aug 11 11:10:51.579499 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Auth-Token: gAAAAABi9OIRfnJpFtGQ5A6DGD3tzjjnbj8hoix-U8-zpHZo5hSEXhAqzDd8qOwUgjdkMuC_FgAY9kfkVldA2-CRi90KY2HEKbLPuClKRqK5ss7wuTuVTSkYcnzqSw74Y-caXwLJ1gamk4Xj2jETroJCKWaJM9wkh4X4EjWZZSdEmT48WtGyxTI Aug 11 11:10:51.579499 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Domain-Id: None Aug 11 11:10:51.579499 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Domain-Name: None Aug 11 11:10:51.579499 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Identity-Status: Confirmed Aug 11 11:10:51.579499 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Is-Admin-Project: True Aug 11 11:10:51.579499 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Domain-Id: default Aug 11 11:10:51.579499 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Domain-Name: Default Aug 11 11:10:51.579499 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Id: b0b3799012d24fad98d155e3b000fc22 Aug 11 11:10:51.579499 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Name: tempest-AttachVolumeTestJSON-1625266365 Aug 11 11:10:51.579499 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Role: reader,member Aug 11 11:10:51.579499 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Roles: reader,member Aug 11 11:10:51.581127 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b0b3799012d24fad98d155e3b000fc22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b0b3799012d24fad98d155e3b000fc22"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b0b3799012d24fad98d155e3b000fc22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b0b3799012d24fad98d155e3b000fc22", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] Aug 11 11:10:51.581127 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant: tempest-AttachVolumeTestJSON-1625266365 Aug 11 11:10:51.581127 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant-Id: b0b3799012d24fad98d155e3b000fc22 Aug 11 11:10:51.581127 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1625266365 Aug 11 11:10:51.581127 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User: tempest-AttachVolumeTestJSON-1625266365-project Aug 11 11:10:51.581127 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Domain-Id: default Aug 11 11:10:51.581127 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Domain-Name: Default Aug 11 11:10:51.581127 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Id: bb18a00d44ed4af186bdc589e1e14e22 Aug 11 11:10:51.581127 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Name: tempest-AttachVolumeTestJSON-1625266365-project Aug 11 11:10:51.581127 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: method: > Aug 11 11:10:51.581127 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: exception: Instance 703afaf7-e5a4-486b-a781-4bd2e3b06981 could not be found. Aug 11 11:10:51.581127 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: action_args: {'id': '703afaf7-e5a4-486b-a781-4bd2e3b06981'} Aug 11 11:10:51.582262 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 11:10:51.582262 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:10:51.582262 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 11:10:51.582262 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 11:10:51.582262 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 11:10:51.582262 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 11:10:51.582262 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 11:10:51.582262 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 11:10:51.582262 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 11:10:51.582262 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 11:10:51.582262 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 703afaf7-e5a4-486b-a781-4bd2e3b06981 could not be found. Aug 11 11:10:51.582262 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:10:51.582262 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:10:51.582262 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:10:51.582262 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:10:51.582262 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:10:51.582262 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:10:51.582262 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 11:10:51.582262 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 11:10:51.582262 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 11:10:51.583743 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 11:10:51.583743 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 11 11:10:51.583743 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 11 11:10:51.583743 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 11 11:10:51.583743 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 11 11:10:51.583743 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 11:10:51.583743 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 11:10:51.583743 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 11:10:51.583743 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 11:10:51.583743 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 703afaf7-e5a4-486b-a781-4bd2e3b06981 could not be found. Aug 11 11:10:51.583743 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:10:51.583743 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:10:51.583743 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:10:51.583743 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:10:51.583743 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:10:51.583743 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:10:51.583743 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 11:10:51.583743 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 11:10:51.583743 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 703afaf7-e5a4-486b-a781-4bd2e3b06981 could not be found. Aug 11 11:10:51.583743 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:10:51.585462 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-36d618ca-f0f8-4623-8e07-0aed3fae16c4 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Returning 404 to user: Instance 703afaf7-e5a4-486b-a781-4bd2e3b06981 could not be found. {{(pid=121231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 11:10:51.585462 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-36d618ca-f0f8-4623-8e07-0aed3fae16c4 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "DELETE /compute/v2.1/servers/703afaf7-e5a4-486b-a781-4bd2e3b06981" status: 404 len: 111 microversion: 2.1 time: 0.031782 Aug 11 11:10:51.585462 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 453/921] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Aug 11 11:10:51 2022] DELETE /compute/v2.1/servers/703afaf7-e5a4-486b-a781-4bd2e3b06981 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 11:10:51.590565 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-86ac7fba-6c11-4182-99b6-f33c8ecd6906 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:51.591287 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-86ac7fba-6c11-4182-99b6-f33c8ecd6906 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 703afaf7-e5a4-486b-a781-4bd2e3b06981] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:51.598522 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-86ac7fba-6c11-4182-99b6-f33c8ecd6906 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:51.599001 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-86ac7fba-6c11-4182-99b6-f33c8ecd6906 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:51.599432 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-86ac7fba-6c11-4182-99b6-f33c8ecd6906 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:51.600177 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-86ac7fba-6c11-4182-99b6-f33c8ecd6906 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:51.600667 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-86ac7fba-6c11-4182-99b6-f33c8ecd6906 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:51.601089 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-86ac7fba-6c11-4182-99b6-f33c8ecd6906 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:51.614294 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.wsgi [None req-86ac7fba-6c11-4182-99b6-f33c8ecd6906 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] HTTP exception thrown: Instance 703afaf7-e5a4-486b-a781-4bd2e3b06981 could not be found. Aug 11 11:10:51.615931 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-86ac7fba-6c11-4182-99b6-f33c8ecd6906 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Request method failure captured: Aug 11 11:10:51.615931 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: request: GET /compute/v2.1/servers/703afaf7-e5a4-486b-a781-4bd2e3b06981 HTTP/1.1 Aug 11 11:10:51.615931 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Accept: application/json Aug 11 11:10:51.615931 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Accept-Encoding: identity Aug 11 11:10:51.615931 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Connection: close Aug 11 11:10:51.615931 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Content-Length: 0 Aug 11 11:10:51.615931 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Content-Type: application/json Aug 11 11:10:51.615931 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Host: 10.222.0.48 Aug 11 11:10:51.615931 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Openstack-System-Scope: None Aug 11 11:10:51.615931 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: User-Agent: python-urllib3/1.26.11 Aug 11 11:10:51.615931 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Auth-Token: gAAAAABi9OIRfnJpFtGQ5A6DGD3tzjjnbj8hoix-U8-zpHZo5hSEXhAqzDd8qOwUgjdkMuC_FgAY9kfkVldA2-CRi90KY2HEKbLPuClKRqK5ss7wuTuVTSkYcnzqSw74Y-caXwLJ1gamk4Xj2jETroJCKWaJM9wkh4X4EjWZZSdEmT48WtGyxTI Aug 11 11:10:51.615931 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Domain-Id: None Aug 11 11:10:51.615931 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Domain-Name: None Aug 11 11:10:51.615931 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Identity-Status: Confirmed Aug 11 11:10:51.615931 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Is-Admin-Project: True Aug 11 11:10:51.615931 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Domain-Id: default Aug 11 11:10:51.615931 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Domain-Name: Default Aug 11 11:10:51.615931 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Id: b0b3799012d24fad98d155e3b000fc22 Aug 11 11:10:51.615931 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Name: tempest-AttachVolumeTestJSON-1625266365 Aug 11 11:10:51.615931 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Role: reader,member Aug 11 11:10:51.615931 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Roles: reader,member Aug 11 11:10:51.618066 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b0b3799012d24fad98d155e3b000fc22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b0b3799012d24fad98d155e3b000fc22"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b0b3799012d24fad98d155e3b000fc22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b0b3799012d24fad98d155e3b000fc22", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] Aug 11 11:10:51.618066 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Tenant: tempest-AttachVolumeTestJSON-1625266365 Aug 11 11:10:51.618066 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Tenant-Id: b0b3799012d24fad98d155e3b000fc22 Aug 11 11:10:51.618066 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1625266365 Aug 11 11:10:51.618066 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User: tempest-AttachVolumeTestJSON-1625266365-project Aug 11 11:10:51.618066 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Domain-Id: default Aug 11 11:10:51.618066 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Domain-Name: Default Aug 11 11:10:51.618066 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Id: bb18a00d44ed4af186bdc589e1e14e22 Aug 11 11:10:51.618066 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Name: tempest-AttachVolumeTestJSON-1625266365-project Aug 11 11:10:51.618066 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: method: > Aug 11 11:10:51.618066 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: exception: Instance 703afaf7-e5a4-486b-a781-4bd2e3b06981 could not be found. Aug 11 11:10:51.618066 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: action_args: {'id': '703afaf7-e5a4-486b-a781-4bd2e3b06981'} Aug 11 11:10:51.618990 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 11:10:51.618990 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:10:51.618990 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 11:10:51.618990 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 11:10:51.618990 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 11:10:51.618990 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 11:10:51.618990 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 11:10:51.618990 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 11:10:51.618990 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 11:10:51.618990 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 11:10:51.618990 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 703afaf7-e5a4-486b-a781-4bd2e3b06981 could not be found. Aug 11 11:10:51.618990 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:10:51.618990 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:10:51.618990 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:10:51.618990 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:10:51.618990 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:10:51.618990 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:10:51.618990 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 11:10:51.618990 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 11:10:51.618990 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 11:10:51.620691 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 11:10:51.620691 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 11:10:51.620691 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 11:10:51.620691 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 11:10:51.620691 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 11:10:51.620691 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 11:10:51.620691 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 11:10:51.620691 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 703afaf7-e5a4-486b-a781-4bd2e3b06981 could not be found. Aug 11 11:10:51.620691 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:10:51.620691 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:10:51.620691 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:10:51.620691 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:10:51.620691 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:10:51.620691 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:10:51.620691 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 11:10:51.620691 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 11:10:51.620691 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 703afaf7-e5a4-486b-a781-4bd2e3b06981 could not be found. Aug 11 11:10:51.620691 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:10:51.622405 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-86ac7fba-6c11-4182-99b6-f33c8ecd6906 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Returning 404 to user: Instance 703afaf7-e5a4-486b-a781-4bd2e3b06981 could not be found. {{(pid=121232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 11:10:51.622405 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-86ac7fba-6c11-4182-99b6-f33c8ecd6906 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/703afaf7-e5a4-486b-a781-4bd2e3b06981" status: 404 len: 111 microversion: 2.1 time: 0.031790 Aug 11 11:10:51.622405 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 469/922] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:10:51 2022] GET /compute/v2.1/servers/703afaf7-e5a4-486b-a781-4bd2e3b06981 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 11:10:52.887729 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-1c801101-705e-4c12-a987-944b9533aaf4 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:52.887729 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-1c801101-705e-4c12-a987-944b9533aaf4 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:52.887729 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1c801101-705e-4c12-a987-944b9533aaf4 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:52.887729 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1c801101-705e-4c12-a987-944b9533aaf4 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:52.888496 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1c801101-705e-4c12-a987-944b9533aaf4 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:52.888496 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1c801101-705e-4c12-a987-944b9533aaf4 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:52.888496 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1c801101-705e-4c12-a987-944b9533aaf4 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:52.888496 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1c801101-705e-4c12-a987-944b9533aaf4 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:52.900898 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.wsgi [None req-1c801101-705e-4c12-a987-944b9533aaf4 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] HTTP exception thrown: Instance 1797716b-0533-42be-8c06-750959aaf935 could not be found. Aug 11 11:10:52.902421 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-1c801101-705e-4c12-a987-944b9533aaf4 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Request method failure captured: Aug 11 11:10:52.902421 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: request: DELETE /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 HTTP/1.1 Aug 11 11:10:52.902421 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Accept: application/json Aug 11 11:10:52.902421 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Accept-Encoding: identity Aug 11 11:10:52.902421 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Connection: close Aug 11 11:10:52.902421 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Content-Length: 0 Aug 11 11:10:52.902421 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Content-Type: application/json Aug 11 11:10:52.902421 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Host: 10.222.0.48 Aug 11 11:10:52.902421 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Openstack-System-Scope: None Aug 11 11:10:52.902421 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: User-Agent: python-urllib3/1.26.11 Aug 11 11:10:52.902421 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Auth-Token: gAAAAABi9OIRfnJpFtGQ5A6DGD3tzjjnbj8hoix-U8-zpHZo5hSEXhAqzDd8qOwUgjdkMuC_FgAY9kfkVldA2-CRi90KY2HEKbLPuClKRqK5ss7wuTuVTSkYcnzqSw74Y-caXwLJ1gamk4Xj2jETroJCKWaJM9wkh4X4EjWZZSdEmT48WtGyxTI Aug 11 11:10:52.902421 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Domain-Id: None Aug 11 11:10:52.902421 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Domain-Name: None Aug 11 11:10:52.902421 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Identity-Status: Confirmed Aug 11 11:10:52.902421 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Is-Admin-Project: True Aug 11 11:10:52.902421 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Domain-Id: default Aug 11 11:10:52.902421 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Domain-Name: Default Aug 11 11:10:52.902421 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Id: b0b3799012d24fad98d155e3b000fc22 Aug 11 11:10:52.902421 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Name: tempest-AttachVolumeTestJSON-1625266365 Aug 11 11:10:52.902421 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Role: reader,member Aug 11 11:10:52.902421 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Roles: reader,member Aug 11 11:10:52.903959 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b0b3799012d24fad98d155e3b000fc22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b0b3799012d24fad98d155e3b000fc22"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b0b3799012d24fad98d155e3b000fc22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b0b3799012d24fad98d155e3b000fc22", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] Aug 11 11:10:52.903959 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant: tempest-AttachVolumeTestJSON-1625266365 Aug 11 11:10:52.903959 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant-Id: b0b3799012d24fad98d155e3b000fc22 Aug 11 11:10:52.903959 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1625266365 Aug 11 11:10:52.903959 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User: tempest-AttachVolumeTestJSON-1625266365-project Aug 11 11:10:52.903959 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Domain-Id: default Aug 11 11:10:52.903959 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Domain-Name: Default Aug 11 11:10:52.903959 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Id: bb18a00d44ed4af186bdc589e1e14e22 Aug 11 11:10:52.903959 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Name: tempest-AttachVolumeTestJSON-1625266365-project Aug 11 11:10:52.903959 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: method: > Aug 11 11:10:52.903959 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: exception: Instance 1797716b-0533-42be-8c06-750959aaf935 could not be found. Aug 11 11:10:52.903959 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: action_args: {'id': '1797716b-0533-42be-8c06-750959aaf935'} Aug 11 11:10:52.904718 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 11:10:52.904718 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:10:52.904718 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 11:10:52.904718 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 11:10:52.904718 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 11:10:52.904718 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 11:10:52.904718 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 11:10:52.904718 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 11:10:52.904718 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 11:10:52.904718 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 11:10:52.904718 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1797716b-0533-42be-8c06-750959aaf935 could not be found. Aug 11 11:10:52.904718 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:10:52.904718 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:10:52.904718 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:10:52.904718 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:10:52.904718 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:10:52.904718 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:10:52.904718 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 11:10:52.904718 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 11:10:52.904718 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 11:10:52.905931 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 11:10:52.905931 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 11 11:10:52.905931 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 11 11:10:52.905931 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 11 11:10:52.905931 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 11 11:10:52.905931 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 11:10:52.905931 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 11:10:52.905931 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 11:10:52.905931 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 11:10:52.905931 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1797716b-0533-42be-8c06-750959aaf935 could not be found. Aug 11 11:10:52.905931 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:10:52.905931 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:10:52.905931 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:10:52.905931 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:10:52.905931 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:10:52.905931 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:10:52.905931 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 11:10:52.905931 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 11:10:52.905931 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1797716b-0533-42be-8c06-750959aaf935 could not be found. Aug 11 11:10:52.905931 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:10:52.907182 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-1c801101-705e-4c12-a987-944b9533aaf4 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Returning 404 to user: Instance 1797716b-0533-42be-8c06-750959aaf935 could not be found. {{(pid=121231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 11:10:52.907182 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-1c801101-705e-4c12-a987-944b9533aaf4 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "DELETE /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 404 len: 111 microversion: 2.1 time: 0.030838 Aug 11 11:10:52.907182 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 454/923] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Aug 11 11:10:52 2022] DELETE /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 11:10:52.912230 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-a4ab236b-1785-41ca-962e-fd77a50c2c02 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:52.912868 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-a4ab236b-1785-41ca-962e-fd77a50c2c02 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] [instance: 1797716b-0533-42be-8c06-750959aaf935] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:52.920013 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a4ab236b-1785-41ca-962e-fd77a50c2c02 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:52.920490 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a4ab236b-1785-41ca-962e-fd77a50c2c02 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:52.920921 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a4ab236b-1785-41ca-962e-fd77a50c2c02 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:52.921595 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a4ab236b-1785-41ca-962e-fd77a50c2c02 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:52.922042 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a4ab236b-1785-41ca-962e-fd77a50c2c02 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:52.922457 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a4ab236b-1785-41ca-962e-fd77a50c2c02 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:52.935639 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.wsgi [None req-a4ab236b-1785-41ca-962e-fd77a50c2c02 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] HTTP exception thrown: Instance 1797716b-0533-42be-8c06-750959aaf935 could not be found. Aug 11 11:10:52.937151 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-a4ab236b-1785-41ca-962e-fd77a50c2c02 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Request method failure captured: Aug 11 11:10:52.937151 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: request: GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 HTTP/1.1 Aug 11 11:10:52.937151 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Accept: application/json Aug 11 11:10:52.937151 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Accept-Encoding: identity Aug 11 11:10:52.937151 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Connection: close Aug 11 11:10:52.937151 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Content-Length: 0 Aug 11 11:10:52.937151 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Content-Type: application/json Aug 11 11:10:52.937151 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Host: 10.222.0.48 Aug 11 11:10:52.937151 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Openstack-System-Scope: None Aug 11 11:10:52.937151 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: User-Agent: python-urllib3/1.26.11 Aug 11 11:10:52.937151 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Auth-Token: gAAAAABi9OIRfnJpFtGQ5A6DGD3tzjjnbj8hoix-U8-zpHZo5hSEXhAqzDd8qOwUgjdkMuC_FgAY9kfkVldA2-CRi90KY2HEKbLPuClKRqK5ss7wuTuVTSkYcnzqSw74Y-caXwLJ1gamk4Xj2jETroJCKWaJM9wkh4X4EjWZZSdEmT48WtGyxTI Aug 11 11:10:52.937151 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Domain-Id: None Aug 11 11:10:52.937151 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Domain-Name: None Aug 11 11:10:52.937151 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Identity-Status: Confirmed Aug 11 11:10:52.937151 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Is-Admin-Project: True Aug 11 11:10:52.937151 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Domain-Id: default Aug 11 11:10:52.937151 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Domain-Name: Default Aug 11 11:10:52.937151 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Id: b0b3799012d24fad98d155e3b000fc22 Aug 11 11:10:52.937151 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Name: tempest-AttachVolumeTestJSON-1625266365 Aug 11 11:10:52.937151 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Role: reader,member Aug 11 11:10:52.937151 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Roles: reader,member Aug 11 11:10:52.938683 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b0b3799012d24fad98d155e3b000fc22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b0b3799012d24fad98d155e3b000fc22"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b0b3799012d24fad98d155e3b000fc22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b0b3799012d24fad98d155e3b000fc22", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] Aug 11 11:10:52.938683 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Tenant: tempest-AttachVolumeTestJSON-1625266365 Aug 11 11:10:52.938683 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Tenant-Id: b0b3799012d24fad98d155e3b000fc22 Aug 11 11:10:52.938683 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1625266365 Aug 11 11:10:52.938683 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User: tempest-AttachVolumeTestJSON-1625266365-project Aug 11 11:10:52.938683 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Domain-Id: default Aug 11 11:10:52.938683 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Domain-Name: Default Aug 11 11:10:52.938683 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Id: bb18a00d44ed4af186bdc589e1e14e22 Aug 11 11:10:52.938683 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Name: tempest-AttachVolumeTestJSON-1625266365-project Aug 11 11:10:52.938683 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: method: > Aug 11 11:10:52.938683 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: exception: Instance 1797716b-0533-42be-8c06-750959aaf935 could not be found. Aug 11 11:10:52.938683 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: action_args: {'id': '1797716b-0533-42be-8c06-750959aaf935'} Aug 11 11:10:52.939574 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 11:10:52.939574 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:10:52.939574 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 11:10:52.939574 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 11:10:52.939574 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 11:10:52.939574 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 11:10:52.939574 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 11:10:52.939574 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 11:10:52.939574 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 11:10:52.939574 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 11:10:52.939574 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1797716b-0533-42be-8c06-750959aaf935 could not be found. Aug 11 11:10:52.939574 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:10:52.939574 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:10:52.939574 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:10:52.939574 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:10:52.939574 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:10:52.939574 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:10:52.939574 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 11:10:52.939574 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 11:10:52.939574 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 11:10:52.941151 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 11:10:52.941151 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 11:10:52.941151 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 11:10:52.941151 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 11:10:52.941151 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 11:10:52.941151 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 11:10:52.941151 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 11:10:52.941151 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1797716b-0533-42be-8c06-750959aaf935 could not be found. Aug 11 11:10:52.941151 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:10:52.941151 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:10:52.941151 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:10:52.941151 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:10:52.941151 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:10:52.941151 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:10:52.941151 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 11:10:52.941151 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 11:10:52.941151 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1797716b-0533-42be-8c06-750959aaf935 could not be found. Aug 11 11:10:52.941151 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:10:52.942488 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-a4ab236b-1785-41ca-962e-fd77a50c2c02 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] Returning 404 to user: Instance 1797716b-0533-42be-8c06-750959aaf935 could not be found. {{(pid=121232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 11:10:52.942488 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-a4ab236b-1785-41ca-962e-fd77a50c2c02 tempest-AttachVolumeTestJSON-1625266365 tempest-AttachVolumeTestJSON-1625266365-project] 10.222.0.48 "GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935" status: 404 len: 111 microversion: 2.1 time: 0.030166 Aug 11 11:10:52.942488 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 470/924] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:10:52 2022] GET /compute/v2.1/servers/1797716b-0533-42be-8c06-750959aaf935 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 11 11:10:55.085243 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-6f23e564-e1fb-4a71-9aaa-5c816b276e77 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Action: 'create', calling method: .version_select at 0x7faab0ac7b80>, body: {"keypair": {"name": "tempest-keypair-1906300238", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC9y812LKtAWUIK2xrc9lOF0I1ecAcQWWzNXuDeHO4F38GDkfimvLd69uEOeTS9bhAQUFKCWY+ogpOAwjxLeFvEt7Jjdcobg55ObjF1LK+IDfkH0L1smhBit1ST8g3/1Bw=="}} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:10:55.102546 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.quota [None req-6f23e564-e1fb-4a71-9aaa-5c816b276e77 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Getting quotas for project c56bd2a662e34a6395117027b5c28c5b. Resources: {'key_pairs'} {{(pid=121231) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 11:10:55.106651 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.quota [None req-6f23e564-e1fb-4a71-9aaa-5c816b276e77 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Getting quotas for user 08d81bcd5a4f43ce8b4839ee15cb163b and project c56bd2a662e34a6395117027b5c28c5b. Resources: {'key_pairs'} {{(pid=121231) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 11:10:55.191028 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-6f23e564-e1fb-4a71-9aaa-5c816b276e77 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.109733 Aug 11 11:10:55.191701 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 455/925] 10.222.0.48 () {60 vars in 1159 bytes} [Thu Aug 11 11:10:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:10:57.777359 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-3a310537-9d18-41dc-a01b-ecda12570ac8 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1621190226", "imageRef": "05993162-aafd-4f1d-b781-ec09593713e5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e9237d16-c254-4c91-b4d6-ffa10fd31ebe"}], "security_groups": [{"name": "tempest-securitygroup--1707559962"}], "key_name": "tempest-keypair-1906300238", "user_data": "}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:10:57.888473 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.network.neutron [None req-3a310537-9d18-41dc-a01b-ecda12570ac8 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] validate_networks() for [('e9237d16-c254-4c91-b4d6-ffa10fd31ebe', None, None, None, None, None)] {{(pid=121232) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 11 11:10:58.291483 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-3a310537-9d18-41dc-a01b-ecda12570ac8 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Flavor limits 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 11 11:10:58.291939 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-3a310537-9d18-41dc-a01b-ecda12570ac8 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Image limits 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 11 11:10:58.292412 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-3a310537-9d18-41dc-a01b-ecda12570ac8 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Flavor pref 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 11 11:10:58.292820 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-3a310537-9d18-41dc-a01b-ecda12570ac8 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Image pref 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 11 11:10:58.293228 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-3a310537-9d18-41dc-a01b-ecda12570ac8 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 11 11:10:58.311559 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3a310537-9d18-41dc-a01b-ecda12570ac8 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:58.312086 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3a310537-9d18-41dc-a01b-ecda12570ac8 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:58.312519 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3a310537-9d18-41dc-a01b-ecda12570ac8 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:58.313453 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3a310537-9d18-41dc-a01b-ecda12570ac8 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:58.313931 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3a310537-9d18-41dc-a01b-ecda12570ac8 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:58.314353 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3a310537-9d18-41dc-a01b-ecda12570ac8 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:58.332042 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-3a310537-9d18-41dc-a01b-ecda12570ac8 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Getting quotas for project c56bd2a662e34a6395117027b5c28c5b. Resources: {'ram', 'cores', 'instances'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 11:10:58.336049 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-3a310537-9d18-41dc-a01b-ecda12570ac8 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Getting quotas for user 08d81bcd5a4f43ce8b4839ee15cb163b and project c56bd2a662e34a6395117027b5c28c5b. Resources: {'ram', 'cores', 'instances'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 11:10:58.346899 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-3a310537-9d18-41dc-a01b-ecda12570ac8 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Going to run 1 instances... {{(pid=121232) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 11 11:10:58.350523 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-3a310537-9d18-41dc-a01b-ecda12570ac8 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: fce2ee6c-537a-46d3-978e-92597b2c2931] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='05993162-aafd-4f1d-b781-ec09593713e5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121232) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 11 11:10:58.487586 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-3a310537-9d18-41dc-a01b-ecda12570ac8 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.715316 Aug 11 11:10:58.488270 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 471/926] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Aug 11 11:10:57 2022] POST /compute/v2.1/servers => generated 402 bytes in 717 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 11 11:10:58.500149 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-494954fb-5a35-498f-8bc4-42ceff92f1c0 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:58.500827 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-494954fb-5a35-498f-8bc4-42ceff92f1c0 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: fce2ee6c-537a-46d3-978e-92597b2c2931] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:58.559289 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-494954fb-5a35-498f-8bc4-42ceff92f1c0 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08d81bcd5a4f43ce8b4839ee15cb163b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56bd2a662e34a6395117027b5c28c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:58.570390 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-494954fb-5a35-498f-8bc4-42ceff92f1c0 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/fce2ee6c-537a-46d3-978e-92597b2c2931" status: 200 len: 1242 microversion: 2.1 time: 0.073429 Aug 11 11:10:58.571031 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 456/927] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:10:58 2022] GET /compute/v2.1/servers/fce2ee6c-537a-46d3-978e-92597b2c2931 => generated 1242 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:10:59.592055 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-ff2d7270-ac3e-48f1-90fb-22fb12661d87 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:10:59.592695 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-ff2d7270-ac3e-48f1-90fb-22fb12661d87 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: fce2ee6c-537a-46d3-978e-92597b2c2931] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:10:59.607003 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ff2d7270-ac3e-48f1-90fb-22fb12661d87 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:59.608324 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ff2d7270-ac3e-48f1-90fb-22fb12661d87 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:59.609149 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ff2d7270-ac3e-48f1-90fb-22fb12661d87 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:59.610108 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ff2d7270-ac3e-48f1-90fb-22fb12661d87 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:10:59.610591 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ff2d7270-ac3e-48f1-90fb-22fb12661d87 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:10:59.611431 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ff2d7270-ac3e-48f1-90fb-22fb12661d87 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:10:59.675186 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-ff2d7270-ac3e-48f1-90fb-22fb12661d87 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08d81bcd5a4f43ce8b4839ee15cb163b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56bd2a662e34a6395117027b5c28c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:10:59.682958 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-ff2d7270-ac3e-48f1-90fb-22fb12661d87 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/fce2ee6c-537a-46d3-978e-92597b2c2931" status: 200 len: 1246 microversion: 2.1 time: 0.095325 Aug 11 11:10:59.683664 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 472/928] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:10:59 2022] GET /compute/v2.1/servers/fce2ee6c-537a-46d3-978e-92597b2c2931 => generated 1246 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:11:00.704228 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-574072cb-c391-4970-a5ba-1bbb847f113c tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:11:00.705792 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-574072cb-c391-4970-a5ba-1bbb847f113c tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: fce2ee6c-537a-46d3-978e-92597b2c2931] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:11:00.713189 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-574072cb-c391-4970-a5ba-1bbb847f113c tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:11:00.713751 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-574072cb-c391-4970-a5ba-1bbb847f113c tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:11:00.714406 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-574072cb-c391-4970-a5ba-1bbb847f113c tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:11:00.715269 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-574072cb-c391-4970-a5ba-1bbb847f113c tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:11:00.715951 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-574072cb-c391-4970-a5ba-1bbb847f113c tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:11:00.716589 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-574072cb-c391-4970-a5ba-1bbb847f113c tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:11:00.802390 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-574072cb-c391-4970-a5ba-1bbb847f113c tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08d81bcd5a4f43ce8b4839ee15cb163b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56bd2a662e34a6395117027b5c28c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:11:00.811982 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-574072cb-c391-4970-a5ba-1bbb847f113c tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/fce2ee6c-537a-46d3-978e-92597b2c2931" status: 200 len: 1302 microversion: 2.1 time: 0.111662 Aug 11 11:11:00.812587 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 457/929] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:11:00 2022] GET /compute/v2.1/servers/fce2ee6c-537a-46d3-978e-92597b2c2931 => generated 1302 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:11:01.833348 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-18282114-6670-44cd-a859-412ca9e1f409 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:11:01.834135 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-18282114-6670-44cd-a859-412ca9e1f409 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: fce2ee6c-537a-46d3-978e-92597b2c2931] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:11:01.841280 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-18282114-6670-44cd-a859-412ca9e1f409 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:11:01.841756 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-18282114-6670-44cd-a859-412ca9e1f409 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:11:01.842272 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-18282114-6670-44cd-a859-412ca9e1f409 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:11:01.842959 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-18282114-6670-44cd-a859-412ca9e1f409 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:11:01.843402 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-18282114-6670-44cd-a859-412ca9e1f409 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:11:01.843839 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-18282114-6670-44cd-a859-412ca9e1f409 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:11:02.021292 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-18282114-6670-44cd-a859-412ca9e1f409 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08d81bcd5a4f43ce8b4839ee15cb163b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56bd2a662e34a6395117027b5c28c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:11:02.035566 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-18282114-6670-44cd-a859-412ca9e1f409 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/fce2ee6c-537a-46d3-978e-92597b2c2931" status: 200 len: 1368 microversion: 2.1 time: 0.205985 Aug 11 11:11:02.036896 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 473/930] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:11:01 2022] GET /compute/v2.1/servers/fce2ee6c-537a-46d3-978e-92597b2c2931 => generated 1368 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:11:02.417492 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-410a0627-9327-45e4-9806-7fc390677a3e req-79da65b9-f55a-4ffc-ab76-e576e7df0e23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fce2ee6c-537a-46d3-978e-92597b2c2931", "tag": "3fc3df13-de91-4827-8c01-98f38098bdeb"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:11:02.428459 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-410a0627-9327-45e4-9806-7fc390677a3e req-79da65b9-f55a-4ffc-ab76-e576e7df0e23 service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:11:02.429304 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-410a0627-9327-45e4-9806-7fc390677a3e req-79da65b9-f55a-4ffc-ab76-e576e7df0e23 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:11:02.429896 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-410a0627-9327-45e4-9806-7fc390677a3e req-79da65b9-f55a-4ffc-ab76-e576e7df0e23 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:11:02.441411 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-410a0627-9327-45e4-9806-7fc390677a3e req-79da65b9-f55a-4ffc-ab76-e576e7df0e23 service nova] Creating event network-changed:3fc3df13-de91-4827-8c01-98f38098bdeb for instance fce2ee6c-537a-46d3-978e-92597b2c2931 on hv-cinder-82002 Aug 11 11:11:02.447173 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-410a0627-9327-45e4-9806-7fc390677a3e req-79da65b9-f55a-4ffc-ab76-e576e7df0e23 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033584 Aug 11 11:11:02.447809 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 458/931] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:11:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:11:03.060127 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-ce43d75f-2f89-43a1-8f28-eb4f53dad4fc tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:11:03.061431 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-ce43d75f-2f89-43a1-8f28-eb4f53dad4fc tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: fce2ee6c-537a-46d3-978e-92597b2c2931] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:11:03.068202 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ce43d75f-2f89-43a1-8f28-eb4f53dad4fc tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:11:03.068686 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ce43d75f-2f89-43a1-8f28-eb4f53dad4fc tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:11:03.069118 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ce43d75f-2f89-43a1-8f28-eb4f53dad4fc tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:11:03.070635 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ce43d75f-2f89-43a1-8f28-eb4f53dad4fc tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:11:03.071088 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ce43d75f-2f89-43a1-8f28-eb4f53dad4fc tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:11:03.071504 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ce43d75f-2f89-43a1-8f28-eb4f53dad4fc tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:11:03.357057 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-ce43d75f-2f89-43a1-8f28-eb4f53dad4fc tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08d81bcd5a4f43ce8b4839ee15cb163b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56bd2a662e34a6395117027b5c28c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:11:03.374664 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-ce43d75f-2f89-43a1-8f28-eb4f53dad4fc tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/fce2ee6c-537a-46d3-978e-92597b2c2931" status: 200 len: 1368 microversion: 2.1 time: 0.319750 Aug 11 11:11:03.375248 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 474/932] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:11:03 2022] GET /compute/v2.1/servers/fce2ee6c-537a-46d3-978e-92597b2c2931 => generated 1368 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:11:04.396059 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-99d98249-f9ae-4406-8f73-f594e0dbe048 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:11:04.396900 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-99d98249-f9ae-4406-8f73-f594e0dbe048 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: fce2ee6c-537a-46d3-978e-92597b2c2931] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:11:04.403042 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-99d98249-f9ae-4406-8f73-f594e0dbe048 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:11:04.403525 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-99d98249-f9ae-4406-8f73-f594e0dbe048 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:11:04.404005 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-99d98249-f9ae-4406-8f73-f594e0dbe048 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:11:04.404704 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-99d98249-f9ae-4406-8f73-f594e0dbe048 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:11:04.405156 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-99d98249-f9ae-4406-8f73-f594e0dbe048 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:11:04.405583 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-99d98249-f9ae-4406-8f73-f594e0dbe048 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:11:04.805299 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-99d98249-f9ae-4406-8f73-f594e0dbe048 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08d81bcd5a4f43ce8b4839ee15cb163b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56bd2a662e34a6395117027b5c28c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:11:04.807688 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:11:04.813516 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-99d98249-f9ae-4406-8f73-f594e0dbe048 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/fce2ee6c-537a-46d3-978e-92597b2c2931" status: 200 len: 1368 microversion: 2.1 time: 0.422431 Aug 11 11:11:04.814071 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 459/933] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:11:04 2022] GET /compute/v2.1/servers/fce2ee6c-537a-46d3-978e-92597b2c2931 => generated 1368 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:11:05.834249 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-15dfbd23-a5d8-43a5-a762-5ec4f43c9c27 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:11:05.834923 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-15dfbd23-a5d8-43a5-a762-5ec4f43c9c27 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: fce2ee6c-537a-46d3-978e-92597b2c2931] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:11:05.841457 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-15dfbd23-a5d8-43a5-a762-5ec4f43c9c27 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:11:05.842072 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-15dfbd23-a5d8-43a5-a762-5ec4f43c9c27 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:11:05.842510 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-15dfbd23-a5d8-43a5-a762-5ec4f43c9c27 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:11:05.843197 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-15dfbd23-a5d8-43a5-a762-5ec4f43c9c27 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:11:05.843648 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-15dfbd23-a5d8-43a5-a762-5ec4f43c9c27 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:11:05.844100 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-15dfbd23-a5d8-43a5-a762-5ec4f43c9c27 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:11:05.996610 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-15dfbd23-a5d8-43a5-a762-5ec4f43c9c27 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08d81bcd5a4f43ce8b4839ee15cb163b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56bd2a662e34a6395117027b5c28c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:11:06.005030 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-15dfbd23-a5d8-43a5-a762-5ec4f43c9c27 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/fce2ee6c-537a-46d3-978e-92597b2c2931" status: 200 len: 1368 microversion: 2.1 time: 0.174889 Aug 11 11:11:06.005806 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 475/934] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:11:05 2022] GET /compute/v2.1/servers/fce2ee6c-537a-46d3-978e-92597b2c2931 => generated 1368 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:11:07.026990 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-a9d27555-fc38-4a1b-b7a2-b9d5a8bfeae9 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:11:07.027583 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-a9d27555-fc38-4a1b-b7a2-b9d5a8bfeae9 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: fce2ee6c-537a-46d3-978e-92597b2c2931] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:11:07.034770 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a9d27555-fc38-4a1b-b7a2-b9d5a8bfeae9 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:11:07.035253 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a9d27555-fc38-4a1b-b7a2-b9d5a8bfeae9 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:11:07.035687 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a9d27555-fc38-4a1b-b7a2-b9d5a8bfeae9 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:11:07.036399 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a9d27555-fc38-4a1b-b7a2-b9d5a8bfeae9 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:11:07.036849 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a9d27555-fc38-4a1b-b7a2-b9d5a8bfeae9 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:11:07.037271 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a9d27555-fc38-4a1b-b7a2-b9d5a8bfeae9 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:11:07.166477 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-a9d27555-fc38-4a1b-b7a2-b9d5a8bfeae9 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08d81bcd5a4f43ce8b4839ee15cb163b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56bd2a662e34a6395117027b5c28c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:11:07.173766 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-a9d27555-fc38-4a1b-b7a2-b9d5a8bfeae9 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/fce2ee6c-537a-46d3-978e-92597b2c2931" status: 200 len: 1368 microversion: 2.1 time: 0.150687 Aug 11 11:11:07.174324 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 460/935] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:11:07 2022] GET /compute/v2.1/servers/fce2ee6c-537a-46d3-978e-92597b2c2931 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:11:08.194049 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-7843a6d4-6a7d-4a48-91cb-f6b7df1f603d tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:11:08.197879 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-7843a6d4-6a7d-4a48-91cb-f6b7df1f603d tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: fce2ee6c-537a-46d3-978e-92597b2c2931] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:11:08.202905 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7843a6d4-6a7d-4a48-91cb-f6b7df1f603d tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:11:08.203401 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7843a6d4-6a7d-4a48-91cb-f6b7df1f603d tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:11:08.203863 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7843a6d4-6a7d-4a48-91cb-f6b7df1f603d tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:11:08.204816 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7843a6d4-6a7d-4a48-91cb-f6b7df1f603d tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:11:08.205556 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7843a6d4-6a7d-4a48-91cb-f6b7df1f603d tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:11:08.206205 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7843a6d4-6a7d-4a48-91cb-f6b7df1f603d tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:11:08.321040 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell0:SELECT=2 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:11:08.327295 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-2e0baeb0-0c5c-46f3-9f67-b196ee3c5294 req-77712bcf-ecd3-4d75-8d11-494173ef767d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fce2ee6c-537a-46d3-978e-92597b2c2931", "name": "network-vif-plugged", "status": "completed", "tag": "3fc3df13-de91-4827-8c01-98f38098bdeb"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:11:08.339113 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-2e0baeb0-0c5c-46f3-9f67-b196ee3c5294 req-77712bcf-ecd3-4d75-8d11-494173ef767d service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:11:08.339870 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-2e0baeb0-0c5c-46f3-9f67-b196ee3c5294 req-77712bcf-ecd3-4d75-8d11-494173ef767d service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:11:08.340507 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-2e0baeb0-0c5c-46f3-9f67-b196ee3c5294 req-77712bcf-ecd3-4d75-8d11-494173ef767d service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:11:08.342961 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell0:SELECT=6 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:11:08.352199 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-2e0baeb0-0c5c-46f3-9f67-b196ee3c5294 req-77712bcf-ecd3-4d75-8d11-494173ef767d service nova] Creating event network-vif-plugged:3fc3df13-de91-4827-8c01-98f38098bdeb for instance fce2ee6c-537a-46d3-978e-92597b2c2931 on hv-cinder-82002 Aug 11 11:11:08.357626 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-2e0baeb0-0c5c-46f3-9f67-b196ee3c5294 req-77712bcf-ecd3-4d75-8d11-494173ef767d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034773 Aug 11 11:11:08.358644 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 461/936] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:11:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:11:08.363319 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-7843a6d4-6a7d-4a48-91cb-f6b7df1f603d tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08d81bcd5a4f43ce8b4839ee15cb163b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56bd2a662e34a6395117027b5c28c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:11:08.371405 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-7843a6d4-6a7d-4a48-91cb-f6b7df1f603d tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/fce2ee6c-537a-46d3-978e-92597b2c2931" status: 200 len: 1368 microversion: 2.1 time: 0.181723 Aug 11 11:11:08.379885 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 476/937] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:11:08 2022] GET /compute/v2.1/servers/fce2ee6c-537a-46d3-978e-92597b2c2931 => generated 1368 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:11:09.393073 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-a3a1ac20-ccf9-4ffa-9cc6-f74c9a9bf4f6 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:11:09.393760 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-a3a1ac20-ccf9-4ffa-9cc6-f74c9a9bf4f6 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: fce2ee6c-537a-46d3-978e-92597b2c2931] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:11:09.395742 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell0:SELECT=6 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:11:09.402345 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a3a1ac20-ccf9-4ffa-9cc6-f74c9a9bf4f6 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:11:09.402345 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a3a1ac20-ccf9-4ffa-9cc6-f74c9a9bf4f6 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:11:09.402345 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a3a1ac20-ccf9-4ffa-9cc6-f74c9a9bf4f6 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:11:09.402784 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a3a1ac20-ccf9-4ffa-9cc6-f74c9a9bf4f6 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:11:09.403231 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a3a1ac20-ccf9-4ffa-9cc6-f74c9a9bf4f6 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:11:09.403650 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a3a1ac20-ccf9-4ffa-9cc6-f74c9a9bf4f6 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:11:09.531483 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-a3a1ac20-ccf9-4ffa-9cc6-f74c9a9bf4f6 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08d81bcd5a4f43ce8b4839ee15cb163b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56bd2a662e34a6395117027b5c28c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:11:09.539731 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-a3a1ac20-ccf9-4ffa-9cc6-f74c9a9bf4f6 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/fce2ee6c-537a-46d3-978e-92597b2c2931" status: 200 len: 1368 microversion: 2.1 time: 0.150917 Aug 11 11:11:09.540317 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 462/938] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:11:09 2022] GET /compute/v2.1/servers/fce2ee6c-537a-46d3-978e-92597b2c2931 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:11:10.560379 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-3d3c561e-dc42-4520-8158-e1a1a77eab6d tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:11:10.561409 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-3d3c561e-dc42-4520-8158-e1a1a77eab6d tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: fce2ee6c-537a-46d3-978e-92597b2c2931] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:11:10.568248 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3d3c561e-dc42-4520-8158-e1a1a77eab6d tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:11:10.569265 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3d3c561e-dc42-4520-8158-e1a1a77eab6d tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:11:10.569702 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3d3c561e-dc42-4520-8158-e1a1a77eab6d tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:11:10.570393 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3d3c561e-dc42-4520-8158-e1a1a77eab6d tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:11:10.571032 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3d3c561e-dc42-4520-8158-e1a1a77eab6d tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:11:10.571461 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3d3c561e-dc42-4520-8158-e1a1a77eab6d tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:11:10.708682 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-3d3c561e-dc42-4520-8158-e1a1a77eab6d tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08d81bcd5a4f43ce8b4839ee15cb163b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56bd2a662e34a6395117027b5c28c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:11:10.713528 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-3d3c561e-dc42-4520-8158-e1a1a77eab6d tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/fce2ee6c-537a-46d3-978e-92597b2c2931" status: 200 len: 1557 microversion: 2.1 time: 0.157550 Aug 11 11:11:10.714106 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 477/939] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:11:10 2022] GET /compute/v2.1/servers/fce2ee6c-537a-46d3-978e-92597b2c2931 => generated 1557 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:11:10.734150 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-63c137ab-2dee-4608-843d-d16e634034be tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:11:10.734679 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-63c137ab-2dee-4608-843d-d16e634034be tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: fce2ee6c-537a-46d3-978e-92597b2c2931] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:11:10.748238 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-63c137ab-2dee-4608-843d-d16e634034be tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:11:10.748238 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-63c137ab-2dee-4608-843d-d16e634034be tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:11:10.748238 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-63c137ab-2dee-4608-843d-d16e634034be tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:11:10.748238 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-63c137ab-2dee-4608-843d-d16e634034be tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:11:10.748673 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-63c137ab-2dee-4608-843d-d16e634034be tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:11:10.748673 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-63c137ab-2dee-4608-843d-d16e634034be tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:11:10.825498 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-63c137ab-2dee-4608-843d-d16e634034be tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/fce2ee6c-537a-46d3-978e-92597b2c2931/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095345 Aug 11 11:11:10.826169 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 463/940] 10.222.0.48 () {58 vars in 1275 bytes} [Thu Aug 11 11:11:10 2022] GET /compute/v2.1/servers/fce2ee6c-537a-46d3-978e-92597b2c2931/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:11:11.822801 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-d9147934-fea2-49c6-8a81-39ee832078f7 req-3dee1634-e4b1-4271-aa22-0f8c12eb2d02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fce2ee6c-537a-46d3-978e-92597b2c2931", "tag": "3fc3df13-de91-4827-8c01-98f38098bdeb"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:11:11.832320 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-d9147934-fea2-49c6-8a81-39ee832078f7 req-3dee1634-e4b1-4271-aa22-0f8c12eb2d02 service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:11:11.833334 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-d9147934-fea2-49c6-8a81-39ee832078f7 req-3dee1634-e4b1-4271-aa22-0f8c12eb2d02 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:11:11.833334 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-d9147934-fea2-49c6-8a81-39ee832078f7 req-3dee1634-e4b1-4271-aa22-0f8c12eb2d02 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:11:11.844281 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-d9147934-fea2-49c6-8a81-39ee832078f7 req-3dee1634-e4b1-4271-aa22-0f8c12eb2d02 service nova] Creating event network-changed:3fc3df13-de91-4827-8c01-98f38098bdeb for instance fce2ee6c-537a-46d3-978e-92597b2c2931 on hv-cinder-82002 Aug 11 11:11:11.849484 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-d9147934-fea2-49c6-8a81-39ee832078f7 req-3dee1634-e4b1-4271-aa22-0f8c12eb2d02 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030840 Aug 11 11:11:11.850240 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 478/941] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:11:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:11:24.625998 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:11:24.626751 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell1:SELECT=19 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:11:24.630689 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-b9d9d48c-cccb-4a00-ac3b-0d13ebd85b45 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:11:24.632843 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-b9d9d48c-cccb-4a00-ac3b-0d13ebd85b45 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: ab871db0-6362-4dd3-b29c-b513351e027b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:11:24.638651 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b9d9d48c-cccb-4a00-ac3b-0d13ebd85b45 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:11:24.639133 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b9d9d48c-cccb-4a00-ac3b-0d13ebd85b45 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:11:24.639566 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b9d9d48c-cccb-4a00-ac3b-0d13ebd85b45 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:11:24.640280 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b9d9d48c-cccb-4a00-ac3b-0d13ebd85b45 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:11:24.640734 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b9d9d48c-cccb-4a00-ac3b-0d13ebd85b45 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:11:24.641157 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b9d9d48c-cccb-4a00-ac3b-0d13ebd85b45 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:11:24.670317 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-b9d9d48c-cccb-4a00-ac3b-0d13ebd85b45 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045683 Aug 11 11:11:24.670867 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 464/942] 10.222.0.48 () {60 vars in 1343 bytes} [Thu Aug 11 11:11:24 2022] GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:11:24.732190 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-01fa341c-dd48-4133-855c-b4b7734d9bcd tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:11:24.732712 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-01fa341c-dd48-4133-855c-b4b7734d9bcd tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: ab871db0-6362-4dd3-b29c-b513351e027b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:11:24.735455 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:11:24.736125 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:11:24.741111 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-01fa341c-dd48-4133-855c-b4b7734d9bcd tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:11:24.741594 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-01fa341c-dd48-4133-855c-b4b7734d9bcd tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:11:24.742031 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-01fa341c-dd48-4133-855c-b4b7734d9bcd tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:11:24.742720 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-01fa341c-dd48-4133-855c-b4b7734d9bcd tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:11:24.743176 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-01fa341c-dd48-4133-855c-b4b7734d9bcd tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:11:24.743613 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-01fa341c-dd48-4133-855c-b4b7734d9bcd tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:11:24.768520 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-01fa341c-dd48-4133-855c-b4b7734d9bcd tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: ab871db0-6362-4dd3-b29c-b513351e027b] Going to try to terminate instance {{(pid=121232) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 11 11:11:25.272991 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-01fa341c-dd48-4133-855c-b4b7734d9bcd tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "DELETE /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b" status: 204 len: 0 microversion: 2.20 time: 0.544928 Aug 11 11:11:25.273576 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 479/943] 10.222.0.48 () {60 vars in 1280 bytes} [Thu Aug 11 11:11:24 2022] DELETE /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b => generated 0 bytes in 547 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 11 11:11:25.282019 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-8f47ac01-d228-44f9-b4c9-c28ad1038c70 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:11:25.282624 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-8f47ac01-d228-44f9-b4c9-c28ad1038c70 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: ab871db0-6362-4dd3-b29c-b513351e027b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:11:25.289896 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8f47ac01-d228-44f9-b4c9-c28ad1038c70 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:11:25.290373 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8f47ac01-d228-44f9-b4c9-c28ad1038c70 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:11:25.290808 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8f47ac01-d228-44f9-b4c9-c28ad1038c70 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:11:25.291484 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8f47ac01-d228-44f9-b4c9-c28ad1038c70 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:11:25.291972 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8f47ac01-d228-44f9-b4c9-c28ad1038c70 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:11:25.292393 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8f47ac01-d228-44f9-b4c9-c28ad1038c70 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:11:25.419920 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-8f47ac01-d228-44f9-b4c9-c28ad1038c70 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:11:25.428465 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-8f47ac01-d228-44f9-b4c9-c28ad1038c70 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:11:25.429952 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-8f47ac01-d228-44f9-b4c9-c28ad1038c70 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:11:25.431105 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-8f47ac01-d228-44f9-b4c9-c28ad1038c70 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b" status: 200 len: 1723 microversion: 2.20 time: 0.153306 Aug 11 11:11:25.431661 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 465/944] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:11:25 2022] GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:11:26.454647 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-1d67ba94-7d9c-4b72-be21-dded875981a5 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:11:26.455366 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-1d67ba94-7d9c-4b72-be21-dded875981a5 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: ab871db0-6362-4dd3-b29c-b513351e027b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:11:26.462511 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1d67ba94-7d9c-4b72-be21-dded875981a5 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:11:26.462998 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1d67ba94-7d9c-4b72-be21-dded875981a5 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:11:26.463434 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1d67ba94-7d9c-4b72-be21-dded875981a5 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:11:26.464182 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1d67ba94-7d9c-4b72-be21-dded875981a5 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:11:26.464635 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1d67ba94-7d9c-4b72-be21-dded875981a5 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:11:26.465062 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1d67ba94-7d9c-4b72-be21-dded875981a5 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:11:26.609533 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-1d67ba94-7d9c-4b72-be21-dded875981a5 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:11:26.617585 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-1d67ba94-7d9c-4b72-be21-dded875981a5 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:11:26.619128 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-1d67ba94-7d9c-4b72-be21-dded875981a5 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:11:26.620325 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-1d67ba94-7d9c-4b72-be21-dded875981a5 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b" status: 200 len: 1723 microversion: 2.20 time: 0.170400 Aug 11 11:11:26.620888 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 480/945] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:11:26 2022] GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:11:27.642466 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-d84b15d1-f889-4fa6-82be-50f2738f14f1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:11:27.643071 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-d84b15d1-f889-4fa6-82be-50f2738f14f1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: ab871db0-6362-4dd3-b29c-b513351e027b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:11:27.649588 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d84b15d1-f889-4fa6-82be-50f2738f14f1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:11:27.650076 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d84b15d1-f889-4fa6-82be-50f2738f14f1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:11:27.650508 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d84b15d1-f889-4fa6-82be-50f2738f14f1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:11:27.651190 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d84b15d1-f889-4fa6-82be-50f2738f14f1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:11:27.651635 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d84b15d1-f889-4fa6-82be-50f2738f14f1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:11:27.652082 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d84b15d1-f889-4fa6-82be-50f2738f14f1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:11:27.740620 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-d84b15d1-f889-4fa6-82be-50f2738f14f1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:11:27.749626 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-d84b15d1-f889-4fa6-82be-50f2738f14f1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:11:27.751205 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-d84b15d1-f889-4fa6-82be-50f2738f14f1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:11:27.752567 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-d84b15d1-f889-4fa6-82be-50f2738f14f1 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b" status: 200 len: 1656 microversion: 2.20 time: 0.113874 Aug 11 11:11:27.753206 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 466/946] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:11:27 2022] GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b => generated 1656 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:11:27.932477 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-7f487cda-c1f0-41df-a63c-df4c13f99e3f req-d0762812-c923-4c76-a58d-bb537bc32f34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab871db0-6362-4dd3-b29c-b513351e027b", "name": "network-vif-deleted", "tag": "1f4049ad-be47-41fe-a43f-26460abf19d8"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:11:27.949911 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-7f487cda-c1f0-41df-a63c-df4c13f99e3f req-d0762812-c923-4c76-a58d-bb537bc32f34 service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:11:27.953037 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-7f487cda-c1f0-41df-a63c-df4c13f99e3f req-d0762812-c923-4c76-a58d-bb537bc32f34 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:11:27.953037 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-7f487cda-c1f0-41df-a63c-df4c13f99e3f req-d0762812-c923-4c76-a58d-bb537bc32f34 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:11:27.967826 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-7f487cda-c1f0-41df-a63c-df4c13f99e3f req-d0762812-c923-4c76-a58d-bb537bc32f34 service nova] Creating event network-vif-deleted:1f4049ad-be47-41fe-a43f-26460abf19d8 for instance ab871db0-6362-4dd3-b29c-b513351e027b on hv-cinder-82002 Aug 11 11:11:27.978672 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-7f487cda-c1f0-41df-a63c-df4c13f99e3f req-d0762812-c923-4c76-a58d-bb537bc32f34 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050745 Aug 11 11:11:27.979722 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 481/947] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:11:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 11:11:28.775434 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-23d5f3b2-c711-43f5-923c-78a25f8a619e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:11:28.776409 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-23d5f3b2-c711-43f5-923c-78a25f8a619e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: ab871db0-6362-4dd3-b29c-b513351e027b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:11:28.783431 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-23d5f3b2-c711-43f5-923c-78a25f8a619e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:11:28.783951 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-23d5f3b2-c711-43f5-923c-78a25f8a619e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:11:28.784389 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-23d5f3b2-c711-43f5-923c-78a25f8a619e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:11:28.785300 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-23d5f3b2-c711-43f5-923c-78a25f8a619e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:11:28.785946 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-23d5f3b2-c711-43f5-923c-78a25f8a619e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:11:28.786405 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-23d5f3b2-c711-43f5-923c-78a25f8a619e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:11:28.832349 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-23d5f3b2-c711-43f5-923c-78a25f8a619e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:11:28.833220 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-23d5f3b2-c711-43f5-923c-78a25f8a619e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:11:28.834187 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-23d5f3b2-c711-43f5-923c-78a25f8a619e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:11:28.834869 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.objects.instance [None req-23d5f3b2-c711-43f5-923c-78a25f8a619e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lazy-loading 'fault' on Instance uuid ab871db0-6362-4dd3-b29c-b513351e027b {{(pid=121231) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 11:11:28.884439 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-23d5f3b2-c711-43f5-923c-78a25f8a619e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:11:28.892900 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-23d5f3b2-c711-43f5-923c-78a25f8a619e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:11:28.894443 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-23d5f3b2-c711-43f5-923c-78a25f8a619e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1b7724f3ef4543ed9c3df0455ae4fb76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c42a3b4ef2d644b58856779226688f88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:11:28.895644 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-23d5f3b2-c711-43f5-923c-78a25f8a619e tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b" status: 200 len: 1372 microversion: 2.20 time: 0.124417 Aug 11 11:11:28.896435 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 467/948] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:11:28 2022] GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b => generated 1372 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 11 11:11:29.920098 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-dfc56f0d-c2eb-48bc-8e4d-7222bacd2de8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:11:29.920780 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-dfc56f0d-c2eb-48bc-8e4d-7222bacd2de8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: ab871db0-6362-4dd3-b29c-b513351e027b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:11:29.926884 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dfc56f0d-c2eb-48bc-8e4d-7222bacd2de8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:11:29.927363 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dfc56f0d-c2eb-48bc-8e4d-7222bacd2de8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:11:29.927811 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dfc56f0d-c2eb-48bc-8e4d-7222bacd2de8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:11:29.928489 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dfc56f0d-c2eb-48bc-8e4d-7222bacd2de8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:11:29.928933 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dfc56f0d-c2eb-48bc-8e4d-7222bacd2de8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:11:29.929348 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dfc56f0d-c2eb-48bc-8e4d-7222bacd2de8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:11:29.942308 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.wsgi [None req-dfc56f0d-c2eb-48bc-8e4d-7222bacd2de8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] HTTP exception thrown: Instance ab871db0-6362-4dd3-b29c-b513351e027b could not be found. Aug 11 11:11:29.943935 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-dfc56f0d-c2eb-48bc-8e4d-7222bacd2de8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Request method failure captured: Aug 11 11:11:29.943935 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: request: GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b HTTP/1.1 Aug 11 11:11:29.943935 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Accept: application/json Aug 11 11:11:29.943935 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Accept-Encoding: identity Aug 11 11:11:29.943935 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Connection: close Aug 11 11:11:29.943935 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Content-Length: 0 Aug 11 11:11:29.943935 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Content-Type: application/json Aug 11 11:11:29.943935 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Host: 10.222.0.48 Aug 11 11:11:29.943935 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Openstack-System-Scope: None Aug 11 11:11:29.943935 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: User-Agent: python-urllib3/1.26.11 Aug 11 11:11:29.943935 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Auth-Token: gAAAAABi9OIaind48uIVvmwwSl55jcJkxEpAVZyB6nQdk1mWfLgWh8LC4f_b2UqUcZdlSYLC9ri7Dtckz_FnJBPC66nr6BI9o-qDaDKgS3cmtdrMuyXBFqQXPcd6n5yHEgCDE9tBh59Z5qHXanyrEHj4QnsP2iU8hR2FG73mdLPDYggCf2HEuKQ Aug 11 11:11:29.943935 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Domain-Id: None Aug 11 11:11:29.943935 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Domain-Name: None Aug 11 11:11:29.943935 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Identity-Status: Confirmed Aug 11 11:11:29.943935 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Is-Admin-Project: True Aug 11 11:11:29.943935 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Openstack-Nova-Api-Version: 2.20 Aug 11 11:11:29.943935 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Domain-Id: default Aug 11 11:11:29.943935 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Domain-Name: Default Aug 11 11:11:29.943935 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Id: c42a3b4ef2d644b58856779226688f88 Aug 11 11:11:29.943935 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1667074018 Aug 11 11:11:29.943935 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Role: reader,member Aug 11 11:11:29.943935 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Roles: reader,member Aug 11 11:11:29.945735 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c42a3b4ef2d644b58856779226688f88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c42a3b4ef2d644b58856779226688f88"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c42a3b4ef2d644b58856779226688f88"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c42a3b4ef2d644b58856779226688f88", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] Aug 11 11:11:29.945735 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1667074018 Aug 11 11:11:29.945735 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Tenant-Id: c42a3b4ef2d644b58856779226688f88 Aug 11 11:11:29.945735 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1667074018 Aug 11 11:11:29.945735 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User: tempest-AttachVolumeShelveTestJSON-1667074018-project Aug 11 11:11:29.945735 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Domain-Id: default Aug 11 11:11:29.945735 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Domain-Name: Default Aug 11 11:11:29.945735 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Id: 1b7724f3ef4543ed9c3df0455ae4fb76 Aug 11 11:11:29.945735 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1667074018-project Aug 11 11:11:29.945735 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: method: > Aug 11 11:11:29.945735 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: exception: Instance ab871db0-6362-4dd3-b29c-b513351e027b could not be found. Aug 11 11:11:29.945735 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: action_args: {'id': 'ab871db0-6362-4dd3-b29c-b513351e027b'} Aug 11 11:11:29.946668 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 11:11:29.946668 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:11:29.946668 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 11:11:29.946668 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 11:11:29.946668 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 11:11:29.946668 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 11:11:29.946668 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 11:11:29.946668 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 11:11:29.946668 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 11:11:29.946668 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 11:11:29.946668 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab871db0-6362-4dd3-b29c-b513351e027b could not be found. Aug 11 11:11:29.946668 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:11:29.946668 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:11:29.946668 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:11:29.946668 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:11:29.946668 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:11:29.946668 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:11:29.946668 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 11:11:29.946668 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 11:11:29.946668 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 11:11:29.950571 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 11:11:29.950571 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 11:11:29.950571 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 11:11:29.950571 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 11:11:29.950571 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 11:11:29.950571 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 11:11:29.950571 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 11:11:29.950571 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab871db0-6362-4dd3-b29c-b513351e027b could not be found. Aug 11 11:11:29.950571 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:11:29.950571 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:11:29.950571 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:11:29.950571 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:11:29.950571 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:11:29.950571 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:11:29.950571 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 11:11:29.950571 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 11:11:29.950571 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab871db0-6362-4dd3-b29c-b513351e027b could not be found. Aug 11 11:11:29.950571 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:11:29.952090 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-dfc56f0d-c2eb-48bc-8e4d-7222bacd2de8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Returning 404 to user: Instance ab871db0-6362-4dd3-b29c-b513351e027b could not be found. {{(pid=121232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 11:11:29.952090 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-dfc56f0d-c2eb-48bc-8e4d-7222bacd2de8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b" status: 404 len: 111 microversion: 2.20 time: 0.030007 Aug 11 11:11:29.952090 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 482/949] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:11:29 2022] GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 11 11:11:29.954115 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-0d68a005-8a75-4bf6-9f15-9df83204f649 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '.version_select at 0x7faab0940820>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:11:30.136743 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-0d68a005-8a75-4bf6-9f15-9df83204f649 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1138604088" status: 204 len: 0 microversion: 2.20 time: 0.186330 Aug 11 11:11:30.137250 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 468/950] 10.222.0.48 () {60 vars in 1262 bytes} [Thu Aug 11 11:11:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1138604088 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 11 11:11:32.203627 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-555d63a6-f199-4ef3-a88d-5d39bd62d7f8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:11:32.206921 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-555d63a6-f199-4ef3-a88d-5d39bd62d7f8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: ab871db0-6362-4dd3-b29c-b513351e027b] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:11:32.211126 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-555d63a6-f199-4ef3-a88d-5d39bd62d7f8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:11:32.211597 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-555d63a6-f199-4ef3-a88d-5d39bd62d7f8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:11:32.212068 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-555d63a6-f199-4ef3-a88d-5d39bd62d7f8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:11:32.212795 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-555d63a6-f199-4ef3-a88d-5d39bd62d7f8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:11:32.213238 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-555d63a6-f199-4ef3-a88d-5d39bd62d7f8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:11:32.213652 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-555d63a6-f199-4ef3-a88d-5d39bd62d7f8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:11:32.226883 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.wsgi [None req-555d63a6-f199-4ef3-a88d-5d39bd62d7f8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] HTTP exception thrown: Instance ab871db0-6362-4dd3-b29c-b513351e027b could not be found. Aug 11 11:11:32.228423 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-555d63a6-f199-4ef3-a88d-5d39bd62d7f8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Request method failure captured: Aug 11 11:11:32.228423 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: request: DELETE /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b HTTP/1.1 Aug 11 11:11:32.228423 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Accept: application/json Aug 11 11:11:32.228423 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Accept-Encoding: identity Aug 11 11:11:32.228423 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Connection: close Aug 11 11:11:32.228423 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Content-Length: 0 Aug 11 11:11:32.228423 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Content-Type: application/json Aug 11 11:11:32.228423 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Host: 10.222.0.48 Aug 11 11:11:32.228423 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Openstack-System-Scope: None Aug 11 11:11:32.228423 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: User-Agent: python-urllib3/1.26.11 Aug 11 11:11:32.228423 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Auth-Token: gAAAAABi9OIaind48uIVvmwwSl55jcJkxEpAVZyB6nQdk1mWfLgWh8LC4f_b2UqUcZdlSYLC9ri7Dtckz_FnJBPC66nr6BI9o-qDaDKgS3cmtdrMuyXBFqQXPcd6n5yHEgCDE9tBh59Z5qHXanyrEHj4QnsP2iU8hR2FG73mdLPDYggCf2HEuKQ Aug 11 11:11:32.228423 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Domain-Id: None Aug 11 11:11:32.228423 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Domain-Name: None Aug 11 11:11:32.228423 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Identity-Status: Confirmed Aug 11 11:11:32.228423 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Is-Admin-Project: True Aug 11 11:11:32.228423 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Openstack-Nova-Api-Version: 2.20 Aug 11 11:11:32.228423 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Domain-Id: default Aug 11 11:11:32.228423 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Domain-Name: Default Aug 11 11:11:32.228423 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Id: c42a3b4ef2d644b58856779226688f88 Aug 11 11:11:32.228423 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1667074018 Aug 11 11:11:32.228423 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Role: reader,member Aug 11 11:11:32.228423 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Roles: reader,member Aug 11 11:11:32.230101 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c42a3b4ef2d644b58856779226688f88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c42a3b4ef2d644b58856779226688f88"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c42a3b4ef2d644b58856779226688f88"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c42a3b4ef2d644b58856779226688f88", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] Aug 11 11:11:32.230101 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1667074018 Aug 11 11:11:32.230101 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Tenant-Id: c42a3b4ef2d644b58856779226688f88 Aug 11 11:11:32.230101 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1667074018 Aug 11 11:11:32.230101 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User: tempest-AttachVolumeShelveTestJSON-1667074018-project Aug 11 11:11:32.230101 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Domain-Id: default Aug 11 11:11:32.230101 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Domain-Name: Default Aug 11 11:11:32.230101 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Id: 1b7724f3ef4543ed9c3df0455ae4fb76 Aug 11 11:11:32.230101 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1667074018-project Aug 11 11:11:32.230101 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: method: > Aug 11 11:11:32.230101 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: exception: Instance ab871db0-6362-4dd3-b29c-b513351e027b could not be found. Aug 11 11:11:32.230101 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: action_args: {'id': 'ab871db0-6362-4dd3-b29c-b513351e027b'} Aug 11 11:11:32.238179 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 11:11:32.238179 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:11:32.238179 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 11:11:32.238179 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 11:11:32.238179 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 11:11:32.238179 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 11:11:32.238179 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 11:11:32.238179 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 11:11:32.238179 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 11:11:32.238179 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 11:11:32.238179 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab871db0-6362-4dd3-b29c-b513351e027b could not be found. Aug 11 11:11:32.238179 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:11:32.238179 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:11:32.238179 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:11:32.238179 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:11:32.238179 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:11:32.238179 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:11:32.238179 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 11:11:32.238179 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 11:11:32.238179 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 11:11:32.239646 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 11:11:32.239646 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 11 11:11:32.239646 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 11 11:11:32.239646 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 11 11:11:32.239646 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 11 11:11:32.239646 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 11:11:32.239646 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 11:11:32.239646 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 11:11:32.239646 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 11:11:32.239646 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab871db0-6362-4dd3-b29c-b513351e027b could not be found. Aug 11 11:11:32.239646 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:11:32.239646 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:11:32.239646 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:11:32.239646 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:11:32.239646 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:11:32.239646 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:11:32.239646 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 11:11:32.239646 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 11:11:32.239646 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab871db0-6362-4dd3-b29c-b513351e027b could not be found. Aug 11 11:11:32.239646 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:11:32.241237 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-555d63a6-f199-4ef3-a88d-5d39bd62d7f8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Returning 404 to user: Instance ab871db0-6362-4dd3-b29c-b513351e027b could not be found. {{(pid=121232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 11:11:32.241237 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-555d63a6-f199-4ef3-a88d-5d39bd62d7f8 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "DELETE /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b" status: 404 len: 111 microversion: 2.20 time: 0.030128 Aug 11 11:11:32.241237 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 483/951] 10.222.0.48 () {60 vars in 1280 bytes} [Thu Aug 11 11:11:32 2022] DELETE /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 11 11:11:32.241498 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-664765ab-d661-4417-8ac7-70ea814a3bf3 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:11:32.241498 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-664765ab-d661-4417-8ac7-70ea814a3bf3 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: ab871db0-6362-4dd3-b29c-b513351e027b] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:11:32.246949 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-664765ab-d661-4417-8ac7-70ea814a3bf3 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:11:32.247433 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-664765ab-d661-4417-8ac7-70ea814a3bf3 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:11:32.247898 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-664765ab-d661-4417-8ac7-70ea814a3bf3 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:11:32.248594 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-664765ab-d661-4417-8ac7-70ea814a3bf3 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:11:32.249049 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-664765ab-d661-4417-8ac7-70ea814a3bf3 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:11:32.249509 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-664765ab-d661-4417-8ac7-70ea814a3bf3 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:11:32.265040 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.wsgi [None req-664765ab-d661-4417-8ac7-70ea814a3bf3 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] HTTP exception thrown: Instance ab871db0-6362-4dd3-b29c-b513351e027b could not be found. Aug 11 11:11:32.272141 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-664765ab-d661-4417-8ac7-70ea814a3bf3 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Request method failure captured: Aug 11 11:11:32.272141 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: request: GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b HTTP/1.1 Aug 11 11:11:32.272141 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Accept: application/json Aug 11 11:11:32.272141 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Accept-Encoding: identity Aug 11 11:11:32.272141 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Connection: close Aug 11 11:11:32.272141 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Content-Length: 0 Aug 11 11:11:32.272141 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Content-Type: application/json Aug 11 11:11:32.272141 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Host: 10.222.0.48 Aug 11 11:11:32.272141 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Openstack-System-Scope: None Aug 11 11:11:32.272141 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: User-Agent: python-urllib3/1.26.11 Aug 11 11:11:32.272141 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Auth-Token: gAAAAABi9OIaind48uIVvmwwSl55jcJkxEpAVZyB6nQdk1mWfLgWh8LC4f_b2UqUcZdlSYLC9ri7Dtckz_FnJBPC66nr6BI9o-qDaDKgS3cmtdrMuyXBFqQXPcd6n5yHEgCDE9tBh59Z5qHXanyrEHj4QnsP2iU8hR2FG73mdLPDYggCf2HEuKQ Aug 11 11:11:32.272141 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Domain-Id: None Aug 11 11:11:32.272141 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Domain-Name: None Aug 11 11:11:32.272141 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Identity-Status: Confirmed Aug 11 11:11:32.272141 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Is-Admin-Project: True Aug 11 11:11:32.272141 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Openstack-Nova-Api-Version: 2.20 Aug 11 11:11:32.272141 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Domain-Id: default Aug 11 11:11:32.272141 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Domain-Name: Default Aug 11 11:11:32.272141 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Id: c42a3b4ef2d644b58856779226688f88 Aug 11 11:11:32.272141 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1667074018 Aug 11 11:11:32.272141 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Role: reader,member Aug 11 11:11:32.272141 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Roles: reader,member Aug 11 11:11:32.273680 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c42a3b4ef2d644b58856779226688f88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c42a3b4ef2d644b58856779226688f88"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c42a3b4ef2d644b58856779226688f88"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c42a3b4ef2d644b58856779226688f88", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] Aug 11 11:11:32.273680 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1667074018 Aug 11 11:11:32.273680 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant-Id: c42a3b4ef2d644b58856779226688f88 Aug 11 11:11:32.273680 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1667074018 Aug 11 11:11:32.273680 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User: tempest-AttachVolumeShelveTestJSON-1667074018-project Aug 11 11:11:32.273680 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Domain-Id: default Aug 11 11:11:32.273680 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Domain-Name: Default Aug 11 11:11:32.273680 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Id: 1b7724f3ef4543ed9c3df0455ae4fb76 Aug 11 11:11:32.273680 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1667074018-project Aug 11 11:11:32.273680 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: method: > Aug 11 11:11:32.273680 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: exception: Instance ab871db0-6362-4dd3-b29c-b513351e027b could not be found. Aug 11 11:11:32.273680 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: action_args: {'id': 'ab871db0-6362-4dd3-b29c-b513351e027b'} Aug 11 11:11:32.274445 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 11:11:32.274445 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:11:32.274445 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 11:11:32.274445 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 11:11:32.274445 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 11:11:32.274445 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 11:11:32.274445 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 11:11:32.274445 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 11:11:32.274445 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 11:11:32.274445 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 11:11:32.274445 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab871db0-6362-4dd3-b29c-b513351e027b could not be found. Aug 11 11:11:32.274445 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:11:32.274445 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:11:32.274445 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:11:32.274445 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:11:32.274445 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:11:32.274445 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:11:32.274445 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 11:11:32.274445 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 11:11:32.274445 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 11:11:32.275716 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 11:11:32.275716 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 11:11:32.275716 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 11:11:32.275716 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 11:11:32.275716 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 11:11:32.275716 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 11:11:32.275716 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 11:11:32.275716 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab871db0-6362-4dd3-b29c-b513351e027b could not be found. Aug 11 11:11:32.275716 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:11:32.275716 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:11:32.275716 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:11:32.275716 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:11:32.275716 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:11:32.275716 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:11:32.275716 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 11:11:32.275716 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 11:11:32.275716 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab871db0-6362-4dd3-b29c-b513351e027b could not be found. Aug 11 11:11:32.275716 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:11:32.276855 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-664765ab-d661-4417-8ac7-70ea814a3bf3 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Returning 404 to user: Instance ab871db0-6362-4dd3-b29c-b513351e027b could not be found. {{(pid=121231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 11:11:32.276855 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-664765ab-d661-4417-8ac7-70ea814a3bf3 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b" status: 404 len: 111 microversion: 2.20 time: 0.033826 Aug 11 11:11:32.276855 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 469/952] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:11:32 2022] GET /compute/v2.1/servers/ab871db0-6362-4dd3-b29c-b513351e027b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 11 11:11:33.619739 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-d48ee25c-28d8-4ab7-900e-6ff0cfa2e02d tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:11:33.620264 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-d48ee25c-28d8-4ab7-900e-6ff0cfa2e02d tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:11:33.626783 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d48ee25c-28d8-4ab7-900e-6ff0cfa2e02d tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:11:33.627349 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d48ee25c-28d8-4ab7-900e-6ff0cfa2e02d tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:11:33.627804 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d48ee25c-28d8-4ab7-900e-6ff0cfa2e02d tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:11:33.628488 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d48ee25c-28d8-4ab7-900e-6ff0cfa2e02d tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:11:33.628996 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d48ee25c-28d8-4ab7-900e-6ff0cfa2e02d tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:11:33.629418 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d48ee25c-28d8-4ab7-900e-6ff0cfa2e02d tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:11:33.643375 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.wsgi [None req-d48ee25c-28d8-4ab7-900e-6ff0cfa2e02d tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] HTTP exception thrown: Instance 82a61cf6-1f3f-4ced-9806-a06252b9b2cc could not be found. Aug 11 11:11:33.644969 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-d48ee25c-28d8-4ab7-900e-6ff0cfa2e02d tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Request method failure captured: Aug 11 11:11:33.644969 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: request: DELETE /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc HTTP/1.1 Aug 11 11:11:33.644969 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Accept: application/json Aug 11 11:11:33.644969 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Accept-Encoding: identity Aug 11 11:11:33.644969 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Connection: close Aug 11 11:11:33.644969 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Content-Length: 0 Aug 11 11:11:33.644969 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Content-Type: application/json Aug 11 11:11:33.644969 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Host: 10.222.0.48 Aug 11 11:11:33.644969 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Openstack-System-Scope: None Aug 11 11:11:33.644969 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: User-Agent: python-urllib3/1.26.11 Aug 11 11:11:33.644969 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Auth-Token: gAAAAABi9OIaind48uIVvmwwSl55jcJkxEpAVZyB6nQdk1mWfLgWh8LC4f_b2UqUcZdlSYLC9ri7Dtckz_FnJBPC66nr6BI9o-qDaDKgS3cmtdrMuyXBFqQXPcd6n5yHEgCDE9tBh59Z5qHXanyrEHj4QnsP2iU8hR2FG73mdLPDYggCf2HEuKQ Aug 11 11:11:33.644969 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Domain-Id: None Aug 11 11:11:33.644969 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Domain-Name: None Aug 11 11:11:33.644969 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Identity-Status: Confirmed Aug 11 11:11:33.644969 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Is-Admin-Project: True Aug 11 11:11:33.644969 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Openstack-Nova-Api-Version: 2.20 Aug 11 11:11:33.644969 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Domain-Id: default Aug 11 11:11:33.644969 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Domain-Name: Default Aug 11 11:11:33.644969 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Id: c42a3b4ef2d644b58856779226688f88 Aug 11 11:11:33.644969 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1667074018 Aug 11 11:11:33.644969 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Role: reader,member Aug 11 11:11:33.644969 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Roles: reader,member Aug 11 11:11:33.647190 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c42a3b4ef2d644b58856779226688f88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c42a3b4ef2d644b58856779226688f88"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c42a3b4ef2d644b58856779226688f88"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c42a3b4ef2d644b58856779226688f88", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] Aug 11 11:11:33.647190 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1667074018 Aug 11 11:11:33.647190 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Tenant-Id: c42a3b4ef2d644b58856779226688f88 Aug 11 11:11:33.647190 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1667074018 Aug 11 11:11:33.647190 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User: tempest-AttachVolumeShelveTestJSON-1667074018-project Aug 11 11:11:33.647190 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Domain-Id: default Aug 11 11:11:33.647190 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Domain-Name: Default Aug 11 11:11:33.647190 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Id: 1b7724f3ef4543ed9c3df0455ae4fb76 Aug 11 11:11:33.647190 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1667074018-project Aug 11 11:11:33.647190 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: method: > Aug 11 11:11:33.647190 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: exception: Instance 82a61cf6-1f3f-4ced-9806-a06252b9b2cc could not be found. Aug 11 11:11:33.647190 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: action_args: {'id': '82a61cf6-1f3f-4ced-9806-a06252b9b2cc'} Aug 11 11:11:33.648927 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 11:11:33.648927 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:11:33.648927 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 11:11:33.648927 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 11:11:33.648927 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 11:11:33.648927 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 11:11:33.648927 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 11:11:33.648927 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 11:11:33.648927 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 11:11:33.648927 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 11:11:33.648927 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82a61cf6-1f3f-4ced-9806-a06252b9b2cc could not be found. Aug 11 11:11:33.648927 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:11:33.648927 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:11:33.648927 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:11:33.648927 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:11:33.648927 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:11:33.648927 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:11:33.648927 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 11:11:33.648927 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 11:11:33.648927 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 11:11:33.650513 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 11:11:33.650513 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 11 11:11:33.650513 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 11 11:11:33.650513 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 11 11:11:33.650513 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 11 11:11:33.650513 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 11:11:33.650513 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 11:11:33.650513 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 11:11:33.650513 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 11:11:33.650513 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82a61cf6-1f3f-4ced-9806-a06252b9b2cc could not be found. Aug 11 11:11:33.650513 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:11:33.650513 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:11:33.650513 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:11:33.650513 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:11:33.650513 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:11:33.650513 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:11:33.650513 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 11:11:33.650513 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 11:11:33.650513 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82a61cf6-1f3f-4ced-9806-a06252b9b2cc could not be found. Aug 11 11:11:33.650513 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:11:33.652068 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-d48ee25c-28d8-4ab7-900e-6ff0cfa2e02d tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Returning 404 to user: Instance 82a61cf6-1f3f-4ced-9806-a06252b9b2cc could not be found. {{(pid=121232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 11:11:33.652068 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-d48ee25c-28d8-4ab7-900e-6ff0cfa2e02d tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "DELETE /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 404 len: 111 microversion: 2.20 time: 0.031265 Aug 11 11:11:33.652068 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 484/953] 10.222.0.48 () {60 vars in 1280 bytes} [Thu Aug 11 11:11:33 2022] DELETE /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 11 11:11:33.655510 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-841c2197-e144-4120-bc03-44a8d937b691 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:11:33.656160 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-841c2197-e144-4120-bc03-44a8d937b691 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] [instance: 82a61cf6-1f3f-4ced-9806-a06252b9b2cc] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:11:33.662849 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-841c2197-e144-4120-bc03-44a8d937b691 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:11:33.663333 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-841c2197-e144-4120-bc03-44a8d937b691 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:11:33.663790 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-841c2197-e144-4120-bc03-44a8d937b691 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:11:33.664496 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-841c2197-e144-4120-bc03-44a8d937b691 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:11:33.664949 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-841c2197-e144-4120-bc03-44a8d937b691 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:11:33.665377 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-841c2197-e144-4120-bc03-44a8d937b691 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:11:33.678475 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.wsgi [None req-841c2197-e144-4120-bc03-44a8d937b691 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] HTTP exception thrown: Instance 82a61cf6-1f3f-4ced-9806-a06252b9b2cc could not be found. Aug 11 11:11:33.680012 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-841c2197-e144-4120-bc03-44a8d937b691 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Request method failure captured: Aug 11 11:11:33.680012 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: request: GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc HTTP/1.1 Aug 11 11:11:33.680012 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Accept: application/json Aug 11 11:11:33.680012 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Accept-Encoding: identity Aug 11 11:11:33.680012 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Connection: close Aug 11 11:11:33.680012 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Content-Length: 0 Aug 11 11:11:33.680012 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Content-Type: application/json Aug 11 11:11:33.680012 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Host: 10.222.0.48 Aug 11 11:11:33.680012 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Openstack-System-Scope: None Aug 11 11:11:33.680012 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: User-Agent: python-urllib3/1.26.11 Aug 11 11:11:33.680012 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Auth-Token: gAAAAABi9OIaind48uIVvmwwSl55jcJkxEpAVZyB6nQdk1mWfLgWh8LC4f_b2UqUcZdlSYLC9ri7Dtckz_FnJBPC66nr6BI9o-qDaDKgS3cmtdrMuyXBFqQXPcd6n5yHEgCDE9tBh59Z5qHXanyrEHj4QnsP2iU8hR2FG73mdLPDYggCf2HEuKQ Aug 11 11:11:33.680012 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Domain-Id: None Aug 11 11:11:33.680012 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Domain-Name: None Aug 11 11:11:33.680012 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Identity-Status: Confirmed Aug 11 11:11:33.680012 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Is-Admin-Project: True Aug 11 11:11:33.680012 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Openstack-Nova-Api-Version: 2.20 Aug 11 11:11:33.680012 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Domain-Id: default Aug 11 11:11:33.680012 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Domain-Name: Default Aug 11 11:11:33.680012 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Id: c42a3b4ef2d644b58856779226688f88 Aug 11 11:11:33.680012 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1667074018 Aug 11 11:11:33.680012 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Role: reader,member Aug 11 11:11:33.680012 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Roles: reader,member Aug 11 11:11:33.681501 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c42a3b4ef2d644b58856779226688f88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c42a3b4ef2d644b58856779226688f88"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c42a3b4ef2d644b58856779226688f88"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c42a3b4ef2d644b58856779226688f88", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] Aug 11 11:11:33.681501 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1667074018 Aug 11 11:11:33.681501 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant-Id: c42a3b4ef2d644b58856779226688f88 Aug 11 11:11:33.681501 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1667074018 Aug 11 11:11:33.681501 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User: tempest-AttachVolumeShelveTestJSON-1667074018-project Aug 11 11:11:33.681501 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Domain-Id: default Aug 11 11:11:33.681501 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Domain-Name: Default Aug 11 11:11:33.681501 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Id: 1b7724f3ef4543ed9c3df0455ae4fb76 Aug 11 11:11:33.681501 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1667074018-project Aug 11 11:11:33.681501 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: method: > Aug 11 11:11:33.681501 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: exception: Instance 82a61cf6-1f3f-4ced-9806-a06252b9b2cc could not be found. Aug 11 11:11:33.681501 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: action_args: {'id': '82a61cf6-1f3f-4ced-9806-a06252b9b2cc'} Aug 11 11:11:33.682311 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 11:11:33.682311 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:11:33.682311 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 11:11:33.682311 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 11:11:33.682311 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 11:11:33.682311 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 11:11:33.682311 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 11:11:33.682311 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 11:11:33.682311 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 11:11:33.682311 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 11:11:33.682311 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82a61cf6-1f3f-4ced-9806-a06252b9b2cc could not be found. Aug 11 11:11:33.682311 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:11:33.682311 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:11:33.682311 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:11:33.682311 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:11:33.682311 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:11:33.682311 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:11:33.682311 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 11:11:33.682311 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 11:11:33.682311 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 11:11:33.683520 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 11:11:33.683520 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 11:11:33.683520 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 11:11:33.683520 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 11:11:33.683520 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 11:11:33.683520 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 11:11:33.683520 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 11:11:33.683520 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82a61cf6-1f3f-4ced-9806-a06252b9b2cc could not be found. Aug 11 11:11:33.683520 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:11:33.683520 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:11:33.683520 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:11:33.683520 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:11:33.683520 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:11:33.683520 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:11:33.683520 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 11:11:33.683520 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 11:11:33.683520 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82a61cf6-1f3f-4ced-9806-a06252b9b2cc could not be found. Aug 11 11:11:33.683520 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:11:33.684776 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-841c2197-e144-4120-bc03-44a8d937b691 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] Returning 404 to user: Instance 82a61cf6-1f3f-4ced-9806-a06252b9b2cc could not be found. {{(pid=121231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 11:11:33.684776 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-841c2197-e144-4120-bc03-44a8d937b691 tempest-AttachVolumeShelveTestJSON-1667074018 tempest-AttachVolumeShelveTestJSON-1667074018-project] 10.222.0.48 "GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc" status: 404 len: 111 microversion: 2.20 time: 0.029815 Aug 11 11:11:33.684776 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 470/954] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Aug 11 11:11:33 2022] GET /compute/v2.1/servers/82a61cf6-1f3f-4ced-9806-a06252b9b2cc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 11 11:11:39.130963 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-4d9ea8c1-bca7-4488-acfa-ea5dd91720f1 tempest-VolumesGetTestJSON-890282462 tempest-VolumesGetTestJSON-890282462-project] Action: 'create', calling method: .version_select at 0x7faab0b215e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-658170099", "metadata": {"Type": "work"}}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:11:39.692942 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-4d9ea8c1-bca7-4488-acfa-ea5dd91720f1 tempest-VolumesGetTestJSON-890282462 tempest-VolumesGetTestJSON-890282462-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.671035 Aug 11 11:11:39.692942 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 485/955] 10.222.0.48 () {60 vars in 1156 bytes} [Thu Aug 11 11:11:39 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 672 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 11 11:11:39.704767 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-976a1a80-057e-4161-afff-0957d69c167e tempest-VolumesGetTestJSON-890282462 tempest-VolumesGetTestJSON-890282462-project] Calling method '.version_select at 0x7faab096bdc0>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:11:39.759012 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-976a1a80-057e-4161-afff-0957d69c167e tempest-VolumesGetTestJSON-890282462 tempest-VolumesGetTestJSON-890282462-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/951f1dc9-f615-4a30-a8ed-04b25ceec3be" status: 200 len: 352 microversion: 2.1 time: 0.058031 Aug 11 11:11:39.759585 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 471/956] 10.222.0.48 () {58 vars in 1245 bytes} [Thu Aug 11 11:11:39 2022] GET /compute/v2.1/os-volumes/951f1dc9-f615-4a30-a8ed-04b25ceec3be => generated 352 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:11:40.773494 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-01920926-b89c-47ff-b9b4-bd3f730365b8 tempest-VolumesGetTestJSON-890282462 tempest-VolumesGetTestJSON-890282462-project] Calling method '.version_select at 0x7faab54f0a60>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:11:40.819790 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-01920926-b89c-47ff-b9b4-bd3f730365b8 tempest-VolumesGetTestJSON-890282462 tempest-VolumesGetTestJSON-890282462-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/951f1dc9-f615-4a30-a8ed-04b25ceec3be" status: 200 len: 352 microversion: 2.1 time: 0.050824 Aug 11 11:11:40.820353 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 486/957] 10.222.0.48 () {58 vars in 1245 bytes} [Thu Aug 11 11:11:40 2022] GET /compute/v2.1/os-volumes/951f1dc9-f615-4a30-a8ed-04b25ceec3be => generated 352 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:11:41.835233 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-3a182dc8-07f8-4f27-8baf-a4724cf21c90 tempest-VolumesGetTestJSON-890282462 tempest-VolumesGetTestJSON-890282462-project] Calling method '.version_select at 0x7faab0ae0550>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:11:41.887413 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-3a182dc8-07f8-4f27-8baf-a4724cf21c90 tempest-VolumesGetTestJSON-890282462 tempest-VolumesGetTestJSON-890282462-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/951f1dc9-f615-4a30-a8ed-04b25ceec3be" status: 200 len: 352 microversion: 2.1 time: 0.056499 Aug 11 11:11:41.888016 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 472/958] 10.222.0.48 () {58 vars in 1245 bytes} [Thu Aug 11 11:11:41 2022] GET /compute/v2.1/os-volumes/951f1dc9-f615-4a30-a8ed-04b25ceec3be => generated 352 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:11:42.902067 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-7bc92298-fca1-40b1-bec6-98627dbd5aa6 tempest-VolumesGetTestJSON-890282462 tempest-VolumesGetTestJSON-890282462-project] Calling method '.version_select at 0x7faab548d310>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:11:42.956058 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-7bc92298-fca1-40b1-bec6-98627dbd5aa6 tempest-VolumesGetTestJSON-890282462 tempest-VolumesGetTestJSON-890282462-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/951f1dc9-f615-4a30-a8ed-04b25ceec3be" status: 200 len: 352 microversion: 2.1 time: 0.057740 Aug 11 11:11:42.956224 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 487/959] 10.222.0.48 () {58 vars in 1245 bytes} [Thu Aug 11 11:11:42 2022] GET /compute/v2.1/os-volumes/951f1dc9-f615-4a30-a8ed-04b25ceec3be => generated 352 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:11:43.967356 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:11:43.968145 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell1:SELECT=30 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:11:43.973118 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-f182a440-5fec-412d-b909-6aa09f0a38f7 tempest-VolumesGetTestJSON-890282462 tempest-VolumesGetTestJSON-890282462-project] Calling method '.version_select at 0x7faab097f3a0>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:11:44.027168 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-f182a440-5fec-412d-b909-6aa09f0a38f7 tempest-VolumesGetTestJSON-890282462 tempest-VolumesGetTestJSON-890282462-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/951f1dc9-f615-4a30-a8ed-04b25ceec3be" status: 200 len: 353 microversion: 2.1 time: 0.057536 Aug 11 11:11:44.027168 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 473/960] 10.222.0.48 () {58 vars in 1245 bytes} [Thu Aug 11 11:11:43 2022] GET /compute/v2.1/os-volumes/951f1dc9-f615-4a30-a8ed-04b25ceec3be => generated 353 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:11:44.033352 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:11:44.034170 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:11:44.038925 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-a29e78f8-e378-41f2-b2c1-c5dcadc3b86d tempest-VolumesGetTestJSON-890282462 tempest-VolumesGetTestJSON-890282462-project] Calling method '.version_select at 0x7faab0b765e0>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:11:44.085101 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-a29e78f8-e378-41f2-b2c1-c5dcadc3b86d tempest-VolumesGetTestJSON-890282462 tempest-VolumesGetTestJSON-890282462-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/951f1dc9-f615-4a30-a8ed-04b25ceec3be" status: 200 len: 353 microversion: 2.1 time: 0.052396 Aug 11 11:11:44.085778 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 488/961] 10.222.0.48 () {58 vars in 1245 bytes} [Thu Aug 11 11:11:44 2022] GET /compute/v2.1/os-volumes/951f1dc9-f615-4a30-a8ed-04b25ceec3be => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:11:44.103707 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-31ed2372-71a0-4623-93cc-b1859929fe20 tempest-VolumesGetTestJSON-890282462 tempest-VolumesGetTestJSON-890282462-project] Calling method '.version_select at 0x7faab096b8b0>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:11:44.277037 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-31ed2372-71a0-4623-93cc-b1859929fe20 tempest-VolumesGetTestJSON-890282462 tempest-VolumesGetTestJSON-890282462-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/951f1dc9-f615-4a30-a8ed-04b25ceec3be" status: 202 len: 0 microversion: 2.1 time: 0.178012 Aug 11 11:11:44.281782 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 474/962] 10.222.0.48 () {58 vars in 1248 bytes} [Thu Aug 11 11:11:44 2022] DELETE /compute/v2.1/os-volumes/951f1dc9-f615-4a30-a8ed-04b25ceec3be => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 11:11:44.290182 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-76dcafc0-989a-4de9-9b1d-e8a8fee0c46f tempest-VolumesGetTestJSON-890282462 tempest-VolumesGetTestJSON-890282462-project] Calling method '.version_select at 0x7faab0aebf70>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:11:44.340575 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-76dcafc0-989a-4de9-9b1d-e8a8fee0c46f tempest-VolumesGetTestJSON-890282462 tempest-VolumesGetTestJSON-890282462-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/951f1dc9-f615-4a30-a8ed-04b25ceec3be" status: 200 len: 352 microversion: 2.1 time: 0.052572 Aug 11 11:11:44.340575 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 489/963] 10.222.0.48 () {58 vars in 1245 bytes} [Thu Aug 11 11:11:44 2022] GET /compute/v2.1/os-volumes/951f1dc9-f615-4a30-a8ed-04b25ceec3be => generated 352 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:11:45.352044 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-8ee62b37-0bb2-4d7c-8b8d-eb4ae0ecb351 tempest-VolumesGetTestJSON-890282462 tempest-VolumesGetTestJSON-890282462-project] Calling method '.version_select at 0x7faab0b28280>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:11:45.379105 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.wsgi [None req-8ee62b37-0bb2-4d7c-8b8d-eb4ae0ecb351 tempest-VolumesGetTestJSON-890282462 tempest-VolumesGetTestJSON-890282462-project] HTTP exception thrown: Volume 951f1dc9-f615-4a30-a8ed-04b25ceec3be could not be found. Aug 11 11:11:45.381683 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-8ee62b37-0bb2-4d7c-8b8d-eb4ae0ecb351 tempest-VolumesGetTestJSON-890282462 tempest-VolumesGetTestJSON-890282462-project] Request method failure captured: Aug 11 11:11:45.381683 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: request: GET /compute/v2.1/os-volumes/951f1dc9-f615-4a30-a8ed-04b25ceec3be HTTP/1.1 Aug 11 11:11:45.381683 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Accept: application/json Aug 11 11:11:45.381683 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Accept-Encoding: identity Aug 11 11:11:45.381683 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Connection: close Aug 11 11:11:45.381683 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Content-Length: 0 Aug 11 11:11:45.381683 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Content-Type: application/json Aug 11 11:11:45.381683 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Host: 10.222.0.48 Aug 11 11:11:45.381683 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Openstack-System-Scope: None Aug 11 11:11:45.381683 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: User-Agent: python-urllib3/1.26.11 Aug 11 11:11:45.381683 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Auth-Token: gAAAAABi9OPqxBqIxUAyzWnd033iYhCsZ2eTlmG1XoCXjw7kS-NfPnL5tBP2YSXrauYIly_rM4557BOBf_9-8Za9P5FNkrkfgksqw9Bj-DvYZUH_Easqd9q7tNt_RPSCgJoLM95MEgTko4xX-pP2eFa9FNmXrXRR4CgycXK778B-3ACaS8yTA5E Aug 11 11:11:45.381683 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Domain-Id: None Aug 11 11:11:45.381683 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Domain-Name: None Aug 11 11:11:45.381683 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Identity-Status: Confirmed Aug 11 11:11:45.381683 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Is-Admin-Project: True Aug 11 11:11:45.381683 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Domain-Id: default Aug 11 11:11:45.381683 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Domain-Name: Default Aug 11 11:11:45.381683 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Id: bc96075b63ca41be8f5be1fdea69b1fa Aug 11 11:11:45.381683 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Name: tempest-VolumesGetTestJSON-890282462 Aug 11 11:11:45.381683 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Role: reader,member Aug 11 11:11:45.381683 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Roles: reader,member Aug 11 11:11:45.383500 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bc96075b63ca41be8f5be1fdea69b1fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/bc96075b63ca41be8f5be1fdea69b1fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/bc96075b63ca41be8f5be1fdea69b1fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_bc96075b63ca41be8f5be1fdea69b1fa", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] Aug 11 11:11:45.383500 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant: tempest-VolumesGetTestJSON-890282462 Aug 11 11:11:45.383500 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant-Id: bc96075b63ca41be8f5be1fdea69b1fa Aug 11 11:11:45.383500 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant-Name: tempest-VolumesGetTestJSON-890282462 Aug 11 11:11:45.383500 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User: tempest-VolumesGetTestJSON-890282462-project Aug 11 11:11:45.383500 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Domain-Id: default Aug 11 11:11:45.383500 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Domain-Name: Default Aug 11 11:11:45.383500 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Id: f69c530af741495bb30d0971d6e3adcf Aug 11 11:11:45.383500 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Name: tempest-VolumesGetTestJSON-890282462-project Aug 11 11:11:45.383500 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: method: Aug 11 11:11:45.383500 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: exception: Volume 951f1dc9-f615-4a30-a8ed-04b25ceec3be could not be found. Aug 11 11:11:45.383500 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: action_args: {'id': '951f1dc9-f615-4a30-a8ed-04b25ceec3be'} Aug 11 11:11:45.383500 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 11:11:45.384717 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:11:45.384717 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 11 11:11:45.384717 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 11 11:11:45.384717 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 11 11:11:45.384717 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 11 11:11:45.384717 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 11 11:11:45.384717 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 11 11:11:45.384717 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 11 11:11:45.384717 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 11 11:11:45.384717 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 11 11:11:45.384717 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 11 11:11:45.384717 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 11 11:11:45.384717 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 11 11:11:45.384717 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 11 11:11:45.384717 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 11 11:11:45.384717 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 951f1dc9-f615-4a30-a8ed-04b25ceec3be could not be found. (HTTP 404) (Request-ID: req-da24c352-8f64-44a5-9ce4-48e7e675cfea) Aug 11 11:11:45.384717 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:11:45.384717 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:11:45.384717 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:11:45.386008 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:11:45.386008 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 11 11:11:45.386008 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 11 11:11:45.386008 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 11 11:11:45.386008 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 11 11:11:45.386008 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 11 11:11:45.386008 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 11 11:11:45.386008 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 11 11:11:45.386008 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 11 11:11:45.386008 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 11 11:11:45.386008 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 11 11:11:45.386008 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 11 11:11:45.386008 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 11 11:11:45.386008 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 11 11:11:45.386008 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 11 11:11:45.386008 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 11 11:11:45.386008 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 11 11:11:45.386008 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 11 11:11:45.386008 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 11 11:11:45.388027 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 11 11:11:45.388027 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 11 11:11:45.388027 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 11 11:11:45.388027 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 11 11:11:45.388027 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 951f1dc9-f615-4a30-a8ed-04b25ceec3be could not be found. Aug 11 11:11:45.388027 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:11:45.388027 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:11:45.388027 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:11:45.388027 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:11:45.388027 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:11:45.388027 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:11:45.388027 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 11:11:45.388027 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 11:11:45.388027 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 11 11:11:45.388027 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 11 11:11:45.388027 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 11:11:45.388027 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 11:11:45.388027 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 11 11:11:45.388027 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 11:11:45.389609 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 951f1dc9-f615-4a30-a8ed-04b25ceec3be could not be found. Aug 11 11:11:45.389609 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:11:45.389609 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:11:45.389609 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:11:45.389609 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:11:45.389609 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:11:45.389609 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:11:45.389609 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 11:11:45.389609 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 11:11:45.389609 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 951f1dc9-f615-4a30-a8ed-04b25ceec3be could not be found. Aug 11 11:11:45.389609 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:11:45.389609 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-8ee62b37-0bb2-4d7c-8b8d-eb4ae0ecb351 tempest-VolumesGetTestJSON-890282462 tempest-VolumesGetTestJSON-890282462-project] Returning 404 to user: Volume 951f1dc9-f615-4a30-a8ed-04b25ceec3be could not be found. {{(pid=121231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 11:11:45.389609 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-8ee62b37-0bb2-4d7c-8b8d-eb4ae0ecb351 tempest-VolumesGetTestJSON-890282462 tempest-VolumesGetTestJSON-890282462-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/951f1dc9-f615-4a30-a8ed-04b25ceec3be" status: 404 len: 109 microversion: 2.1 time: 0.035906 Aug 11 11:11:45.389609 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 475/964] 10.222.0.48 () {58 vars in 1245 bytes} [Thu Aug 11 11:11:45 2022] GET /compute/v2.1/os-volumes/951f1dc9-f615-4a30-a8ed-04b25ceec3be => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 11 11:11:57.162249 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-bd0fee73-7465-4820-a242-d843d51dfa7d tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:11:57.162795 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-bd0fee73-7465-4820-a242-d843d51dfa7d tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: d1cc9961-0393-433e-9c87-cdd2b8457a85] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:11:57.169455 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bd0fee73-7465-4820-a242-d843d51dfa7d tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:11:57.169946 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bd0fee73-7465-4820-a242-d843d51dfa7d tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:11:57.170383 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bd0fee73-7465-4820-a242-d843d51dfa7d tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:11:57.171090 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bd0fee73-7465-4820-a242-d843d51dfa7d tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:11:57.171527 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bd0fee73-7465-4820-a242-d843d51dfa7d tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:11:57.171997 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bd0fee73-7465-4820-a242-d843d51dfa7d tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:11:57.198097 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-bd0fee73-7465-4820-a242-d843d51dfa7d tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: d1cc9961-0393-433e-9c87-cdd2b8457a85] Going to try to terminate instance {{(pid=121232) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 11 11:11:57.480953 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-bd0fee73-7465-4820-a242-d843d51dfa7d tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d1cc9961-0393-433e-9c87-cdd2b8457a85" status: 204 len: 0 microversion: 2.1 time: 0.323702 Aug 11 11:11:57.481556 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 490/965] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Aug 11 11:11:57 2022] DELETE /compute/v2.1/servers/d1cc9961-0393-433e-9c87-cdd2b8457a85 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 11 11:11:57.490813 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-9544f9e9-3bf6-42f3-abb7-a1933636f0a8 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:11:57.491981 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-9544f9e9-3bf6-42f3-abb7-a1933636f0a8 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: d1cc9961-0393-433e-9c87-cdd2b8457a85] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:11:57.497909 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9544f9e9-3bf6-42f3-abb7-a1933636f0a8 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:11:57.498386 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9544f9e9-3bf6-42f3-abb7-a1933636f0a8 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:11:57.498816 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9544f9e9-3bf6-42f3-abb7-a1933636f0a8 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:11:57.499490 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9544f9e9-3bf6-42f3-abb7-a1933636f0a8 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:11:57.499976 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9544f9e9-3bf6-42f3-abb7-a1933636f0a8 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:11:57.500397 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9544f9e9-3bf6-42f3-abb7-a1933636f0a8 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:11:57.637108 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-9544f9e9-3bf6-42f3-abb7-a1933636f0a8 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9dbe3b7fdd482681b6ab94c26f4e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d394882f294c6283721bcc6f8ff04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:11:57.644555 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-9544f9e9-3bf6-42f3-abb7-a1933636f0a8 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "GET /compute/v2.1/servers/d1cc9961-0393-433e-9c87-cdd2b8457a85" status: 200 len: 1577 microversion: 2.1 time: 0.158825 Aug 11 11:11:57.645117 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 476/966] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:11:57 2022] GET /compute/v2.1/servers/d1cc9961-0393-433e-9c87-cdd2b8457a85 => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:11:58.376436 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-98cbc2eb-b1bf-401a-a96b-28d35d329e66 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:11:58.376975 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-98cbc2eb-b1bf-401a-a96b-28d35d329e66 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: fce2ee6c-537a-46d3-978e-92597b2c2931] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:11:58.383937 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-98cbc2eb-b1bf-401a-a96b-28d35d329e66 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:11:58.384604 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-98cbc2eb-b1bf-401a-a96b-28d35d329e66 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:11:58.385192 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-98cbc2eb-b1bf-401a-a96b-28d35d329e66 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:11:58.386052 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-98cbc2eb-b1bf-401a-a96b-28d35d329e66 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:11:58.386670 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-98cbc2eb-b1bf-401a-a96b-28d35d329e66 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:11:58.387091 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-98cbc2eb-b1bf-401a-a96b-28d35d329e66 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:11:58.412567 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-98cbc2eb-b1bf-401a-a96b-28d35d329e66 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/fce2ee6c-537a-46d3-978e-92597b2c2931/ips" status: 200 len: 149 microversion: 2.1 time: 0.040571 Aug 11 11:11:58.413156 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 491/967] 10.222.0.48 () {58 vars in 1248 bytes} [Thu Aug 11 11:11:58 2022] GET /compute/v2.1/servers/fce2ee6c-537a-46d3-978e-92597b2c2931/ips => generated 149 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:11:58.424467 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-45933b52-eeac-4c13-847c-862e18432964 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d4cc7e22-b71a-4add-958c-8af923db7fa5"}} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:11:58.426862 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-45933b52-eeac-4c13-847c-862e18432964 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: fce2ee6c-537a-46d3-978e-92597b2c2931] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:11:58.432984 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-45933b52-eeac-4c13-847c-862e18432964 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:11:58.433467 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-45933b52-eeac-4c13-847c-862e18432964 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:11:58.433906 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-45933b52-eeac-4c13-847c-862e18432964 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:11:58.434596 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-45933b52-eeac-4c13-847c-862e18432964 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:11:58.435029 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-45933b52-eeac-4c13-847c-862e18432964 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:11:58.435468 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-45933b52-eeac-4c13-847c-862e18432964 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:11:58.514337 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.wsgi [None req-45933b52-eeac-4c13-847c-862e18432964 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] HTTP exception thrown: Invalid volume: volume d4cc7e22-b71a-4add-958c-8af923db7fa5 is already attached to instances: f6bf35b3-de6a-41ae-81b7-8f45852ab5e2 Aug 11 11:11:58.516410 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-45933b52-eeac-4c13-847c-862e18432964 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Request method failure captured: Aug 11 11:11:58.516410 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: request: POST /compute/v2.1/servers/fce2ee6c-537a-46d3-978e-92597b2c2931/os-volume_attachments HTTP/1.1 Aug 11 11:11:58.516410 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Accept: application/json Aug 11 11:11:58.516410 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Accept-Encoding: identity Aug 11 11:11:58.516410 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Connection: close Aug 11 11:11:58.516410 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Content-Length: 74 Aug 11 11:11:58.516410 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Content-Type: application/json Aug 11 11:11:58.516410 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Host: 10.222.0.48 Aug 11 11:11:58.516410 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Openstack-System-Scope: None Aug 11 11:11:58.516410 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: User-Agent: python-urllib3/1.26.11 Aug 11 11:11:58.516410 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Auth-Token: gAAAAABi9ONxPYWpRmadpANSM5f1tl1wVESW1SFE62fiY511YI9uU6D_79r-yuQvgjKjvFqPWeHAiFZFw3kYac2M1zqDX4QPozx6rX_pgfB-Fgz47x90y_mKI7zGyyPs8EkLoYDiomkPvd5a4fE5iPsTlEJ3RRgCL7XDnuCGisjN8PsW1aCU_y4 Aug 11 11:11:58.516410 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Domain-Id: None Aug 11 11:11:58.516410 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Domain-Name: None Aug 11 11:11:58.516410 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Identity-Status: Confirmed Aug 11 11:11:58.516410 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Is-Admin-Project: True Aug 11 11:11:58.516410 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Domain-Id: default Aug 11 11:11:58.516410 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Domain-Name: Default Aug 11 11:11:58.516410 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Id: c56bd2a662e34a6395117027b5c28c5b Aug 11 11:11:58.516410 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Name: tempest-AttachVolumeNegativeTest-848160622 Aug 11 11:11:58.516410 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Role: reader,member Aug 11 11:11:58.516410 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Roles: reader,member Aug 11 11:11:58.518068 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c56bd2a662e34a6395117027b5c28c5b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c56bd2a662e34a6395117027b5c28c5b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c56bd2a662e34a6395117027b5c28c5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c56bd2a662e34a6395117027b5c28c5b", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] Aug 11 11:11:58.518068 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant: tempest-AttachVolumeNegativeTest-848160622 Aug 11 11:11:58.518068 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant-Id: c56bd2a662e34a6395117027b5c28c5b Aug 11 11:11:58.518068 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-848160622 Aug 11 11:11:58.518068 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User: tempest-AttachVolumeNegativeTest-848160622-project Aug 11 11:11:58.518068 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Domain-Id: default Aug 11 11:11:58.518068 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Domain-Name: Default Aug 11 11:11:58.518068 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Id: 08d81bcd5a4f43ce8b4839ee15cb163b Aug 11 11:11:58.518068 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Name: tempest-AttachVolumeNegativeTest-848160622-project Aug 11 11:11:58.518068 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Aug 11 11:11:58.518068 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: {"volumeAttachment": {"volumeId": "d4cc7e22-b71a-4add-958c-8af923db7fa5"}} Aug 11 11:11:58.518068 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: method: > Aug 11 11:11:58.519019 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: exception: Invalid volume: volume d4cc7e22-b71a-4add-958c-8af923db7fa5 is already attached to instances: f6bf35b3-de6a-41ae-81b7-8f45852ab5e2 Aug 11 11:11:58.519019 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: action_args: {'server_id': 'fce2ee6c-537a-46d3-978e-92597b2c2931', 'body': {'volumeAttachment': {'volumeId': 'd4cc7e22-b71a-4add-958c-8af923db7fa5'}}} Aug 11 11:11:58.519019 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 11:11:58.519019 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:11:58.519019 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 11 11:11:58.519019 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 11 11:11:58.519019 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 11 11:11:58.519019 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 11 11:11:58.519019 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 11 11:11:58.519019 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 11 11:11:58.519019 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5079, in attach_volume Aug 11 11:11:58.519019 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 11 11:11:58.519019 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4919, in _check_volume_already_attached Aug 11 11:11:58.519019 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 11 11:11:58.519019 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume d4cc7e22-b71a-4add-958c-8af923db7fa5 is already attached to instances: f6bf35b3-de6a-41ae-81b7-8f45852ab5e2 Aug 11 11:11:58.519019 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:11:58.519019 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:11:58.519019 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:11:58.519019 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:11:58.520545 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:11:58.520545 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:11:58.520545 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 11:11:58.520545 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 11:11:58.520545 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 11:11:58.520545 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 11:11:58.520545 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 11 11:11:58.520545 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 11 11:11:58.520545 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 11 11:11:58.520545 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 11 11:11:58.520545 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 11 11:11:58.520545 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 11 11:11:58.520545 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 11 11:11:58.520545 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 11 11:11:58.520545 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume d4cc7e22-b71a-4add-958c-8af923db7fa5 is already attached to instances: f6bf35b3-de6a-41ae-81b7-8f45852ab5e2 Aug 11 11:11:58.520545 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:11:58.520545 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:11:58.520545 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:11:58.520545 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:11:58.520545 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:11:58.522700 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:11:58.522700 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 11:11:58.522700 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 11:11:58.522700 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume d4cc7e22-b71a-4add-958c-8af923db7fa5 is already attached to instances: f6bf35b3-de6a-41ae-81b7-8f45852ab5e2 Aug 11 11:11:58.522700 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:11:58.522700 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-45933b52-eeac-4c13-847c-862e18432964 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Returning 400 to user: Invalid volume: volume d4cc7e22-b71a-4add-958c-8af923db7fa5 is already attached to instances: f6bf35b3-de6a-41ae-81b7-8f45852ab5e2 {{(pid=121231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 11:11:58.523439 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-45933b52-eeac-4c13-847c-862e18432964 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "POST /compute/v2.1/servers/fce2ee6c-537a-46d3-978e-92597b2c2931/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.101683 Aug 11 11:11:58.524262 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 477/968] 10.222.0.48 () {60 vars in 1323 bytes} [Thu Aug 11 11:11:58 2022] POST /compute/v2.1/servers/fce2ee6c-537a-46d3-978e-92597b2c2931/os-volume_attachments => generated 174 bytes in 105 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 11 11:11:58.532398 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-c0401c0d-eb36-45bb-aab8-9295b9a4f0ba tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:11:58.532888 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-c0401c0d-eb36-45bb-aab8-9295b9a4f0ba tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: fce2ee6c-537a-46d3-978e-92597b2c2931] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:11:58.539494 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c0401c0d-eb36-45bb-aab8-9295b9a4f0ba tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:11:58.540024 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c0401c0d-eb36-45bb-aab8-9295b9a4f0ba tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:11:58.540453 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c0401c0d-eb36-45bb-aab8-9295b9a4f0ba tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:11:58.541129 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c0401c0d-eb36-45bb-aab8-9295b9a4f0ba tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:11:58.541572 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c0401c0d-eb36-45bb-aab8-9295b9a4f0ba tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:11:58.541988 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-c0401c0d-eb36-45bb-aab8-9295b9a4f0ba tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:11:58.570681 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-c0401c0d-eb36-45bb-aab8-9295b9a4f0ba tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: fce2ee6c-537a-46d3-978e-92597b2c2931] Going to try to terminate instance {{(pid=121232) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 11 11:11:58.665734 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-393eee4f-f214-4711-b3dd-6895f8c5c252 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:11:58.666269 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-393eee4f-f214-4711-b3dd-6895f8c5c252 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: d1cc9961-0393-433e-9c87-cdd2b8457a85] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:11:58.673002 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-393eee4f-f214-4711-b3dd-6895f8c5c252 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:11:58.673494 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-393eee4f-f214-4711-b3dd-6895f8c5c252 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:11:58.673985 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-393eee4f-f214-4711-b3dd-6895f8c5c252 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:11:58.674671 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-393eee4f-f214-4711-b3dd-6895f8c5c252 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:11:58.675130 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-393eee4f-f214-4711-b3dd-6895f8c5c252 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:11:58.675561 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-393eee4f-f214-4711-b3dd-6895f8c5c252 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:11:58.805231 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-393eee4f-f214-4711-b3dd-6895f8c5c252 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9dbe3b7fdd482681b6ab94c26f4e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d394882f294c6283721bcc6f8ff04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:11:58.812863 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-393eee4f-f214-4711-b3dd-6895f8c5c252 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "GET /compute/v2.1/servers/d1cc9961-0393-433e-9c87-cdd2b8457a85" status: 200 len: 1577 microversion: 2.1 time: 0.151136 Aug 11 11:11:58.813478 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 478/969] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:11:58 2022] GET /compute/v2.1/servers/d1cc9961-0393-433e-9c87-cdd2b8457a85 => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:11:58.932983 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-c0401c0d-eb36-45bb-aab8-9295b9a4f0ba tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "DELETE /compute/v2.1/servers/fce2ee6c-537a-46d3-978e-92597b2c2931" status: 204 len: 0 microversion: 2.1 time: 0.404090 Aug 11 11:11:58.933527 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 492/970] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Aug 11 11:11:58 2022] DELETE /compute/v2.1/servers/fce2ee6c-537a-46d3-978e-92597b2c2931 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 11 11:11:58.941621 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-0d0f19a6-e9bd-4344-ad65-8b95126f7a9a tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:11:58.942387 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-0d0f19a6-e9bd-4344-ad65-8b95126f7a9a tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: fce2ee6c-537a-46d3-978e-92597b2c2931] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:11:58.948959 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0d0f19a6-e9bd-4344-ad65-8b95126f7a9a tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:11:58.949438 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0d0f19a6-e9bd-4344-ad65-8b95126f7a9a tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:11:58.949870 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0d0f19a6-e9bd-4344-ad65-8b95126f7a9a tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:11:58.950762 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0d0f19a6-e9bd-4344-ad65-8b95126f7a9a tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:11:58.951217 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0d0f19a6-e9bd-4344-ad65-8b95126f7a9a tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:11:58.951636 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0d0f19a6-e9bd-4344-ad65-8b95126f7a9a tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:11:59.087539 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-0d0f19a6-e9bd-4344-ad65-8b95126f7a9a tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08d81bcd5a4f43ce8b4839ee15cb163b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56bd2a662e34a6395117027b5c28c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:11:59.095220 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-0d0f19a6-e9bd-4344-ad65-8b95126f7a9a tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/fce2ee6c-537a-46d3-978e-92597b2c2931" status: 200 len: 1682 microversion: 2.1 time: 0.157508 Aug 11 11:11:59.095806 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 479/971] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:11:58 2022] GET /compute/v2.1/servers/fce2ee6c-537a-46d3-978e-92597b2c2931 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:11:59.835194 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-62124cd5-3b16-43e8-8321-4597bee6dd2d tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:11:59.836088 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-62124cd5-3b16-43e8-8321-4597bee6dd2d tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: d1cc9961-0393-433e-9c87-cdd2b8457a85] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:11:59.842614 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-62124cd5-3b16-43e8-8321-4597bee6dd2d tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:11:59.843102 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-62124cd5-3b16-43e8-8321-4597bee6dd2d tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:11:59.843539 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-62124cd5-3b16-43e8-8321-4597bee6dd2d tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:11:59.844306 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-62124cd5-3b16-43e8-8321-4597bee6dd2d tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:11:59.844758 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-62124cd5-3b16-43e8-8321-4597bee6dd2d tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:11:59.845186 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-62124cd5-3b16-43e8-8321-4597bee6dd2d tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:11:59.989746 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-62124cd5-3b16-43e8-8321-4597bee6dd2d tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9dbe3b7fdd482681b6ab94c26f4e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d394882f294c6283721bcc6f8ff04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:11:59.997995 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-62124cd5-3b16-43e8-8321-4597bee6dd2d tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "GET /compute/v2.1/servers/d1cc9961-0393-433e-9c87-cdd2b8457a85" status: 200 len: 1577 microversion: 2.1 time: 0.167222 Aug 11 11:11:59.998554 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 493/972] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:11:59 2022] GET /compute/v2.1/servers/d1cc9961-0393-433e-9c87-cdd2b8457a85 => generated 1577 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:12:00.119155 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-73335d6b-9332-4056-a289-563aff792207 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:12:00.120413 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-73335d6b-9332-4056-a289-563aff792207 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: fce2ee6c-537a-46d3-978e-92597b2c2931] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:12:00.127179 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-73335d6b-9332-4056-a289-563aff792207 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:00.127669 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-73335d6b-9332-4056-a289-563aff792207 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:00.128139 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-73335d6b-9332-4056-a289-563aff792207 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:00.128836 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-73335d6b-9332-4056-a289-563aff792207 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:00.129290 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-73335d6b-9332-4056-a289-563aff792207 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:00.129714 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-73335d6b-9332-4056-a289-563aff792207 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:00.266731 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-73335d6b-9332-4056-a289-563aff792207 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08d81bcd5a4f43ce8b4839ee15cb163b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56bd2a662e34a6395117027b5c28c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:12:00.275284 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-73335d6b-9332-4056-a289-563aff792207 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/fce2ee6c-537a-46d3-978e-92597b2c2931" status: 200 len: 1682 microversion: 2.1 time: 0.161024 Aug 11 11:12:00.275942 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 480/973] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:12:00 2022] GET /compute/v2.1/servers/fce2ee6c-537a-46d3-978e-92597b2c2931 => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:12:01.018742 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-5337c3e1-9536-4bb7-b53a-ae15f9f528d0 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:12:01.019351 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-5337c3e1-9536-4bb7-b53a-ae15f9f528d0 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: d1cc9961-0393-433e-9c87-cdd2b8457a85] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:12:01.025888 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5337c3e1-9536-4bb7-b53a-ae15f9f528d0 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:01.026370 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5337c3e1-9536-4bb7-b53a-ae15f9f528d0 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:01.026987 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5337c3e1-9536-4bb7-b53a-ae15f9f528d0 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:01.027671 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5337c3e1-9536-4bb7-b53a-ae15f9f528d0 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:01.028142 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5337c3e1-9536-4bb7-b53a-ae15f9f528d0 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:01.028597 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5337c3e1-9536-4bb7-b53a-ae15f9f528d0 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:01.170825 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-5337c3e1-9536-4bb7-b53a-ae15f9f528d0 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9dbe3b7fdd482681b6ab94c26f4e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d394882f294c6283721bcc6f8ff04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:12:01.179297 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-5337c3e1-9536-4bb7-b53a-ae15f9f528d0 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "GET /compute/v2.1/servers/d1cc9961-0393-433e-9c87-cdd2b8457a85" status: 200 len: 1577 microversion: 2.1 time: 0.164500 Aug 11 11:12:01.179910 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 494/974] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:12:01 2022] GET /compute/v2.1/servers/d1cc9961-0393-433e-9c87-cdd2b8457a85 => generated 1577 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:12:01.296233 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-30c4b11c-261b-492d-903d-2d4c04b88c4b tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:12:01.296889 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-30c4b11c-261b-492d-903d-2d4c04b88c4b tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: fce2ee6c-537a-46d3-978e-92597b2c2931] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:12:01.303776 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-30c4b11c-261b-492d-903d-2d4c04b88c4b tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:01.304275 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-30c4b11c-261b-492d-903d-2d4c04b88c4b tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:01.304706 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-30c4b11c-261b-492d-903d-2d4c04b88c4b tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:01.305392 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-30c4b11c-261b-492d-903d-2d4c04b88c4b tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:01.305845 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-30c4b11c-261b-492d-903d-2d4c04b88c4b tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:01.306270 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-30c4b11c-261b-492d-903d-2d4c04b88c4b tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:01.449858 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-30c4b11c-261b-492d-903d-2d4c04b88c4b tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08d81bcd5a4f43ce8b4839ee15cb163b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56bd2a662e34a6395117027b5c28c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:12:01.457969 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-30c4b11c-261b-492d-903d-2d4c04b88c4b tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/fce2ee6c-537a-46d3-978e-92597b2c2931" status: 200 len: 1682 microversion: 2.1 time: 0.165544 Aug 11 11:12:01.458715 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 481/975] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:12:01 2022] GET /compute/v2.1/servers/fce2ee6c-537a-46d3-978e-92597b2c2931 => generated 1682 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:12:02.201566 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-86262e21-1884-4f3f-9d40-1a000bd43407 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:12:02.202266 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-86262e21-1884-4f3f-9d40-1a000bd43407 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: d1cc9961-0393-433e-9c87-cdd2b8457a85] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:12:02.211012 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-86262e21-1884-4f3f-9d40-1a000bd43407 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:02.211601 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-86262e21-1884-4f3f-9d40-1a000bd43407 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:02.212155 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-86262e21-1884-4f3f-9d40-1a000bd43407 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:02.213245 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-86262e21-1884-4f3f-9d40-1a000bd43407 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:02.213930 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-86262e21-1884-4f3f-9d40-1a000bd43407 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:02.214394 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-86262e21-1884-4f3f-9d40-1a000bd43407 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:02.483561 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-f6eeb414-599c-4d7c-b555-c12b258cef71 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:12:02.485059 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-f6eeb414-599c-4d7c-b555-c12b258cef71 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: fce2ee6c-537a-46d3-978e-92597b2c2931] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:12:02.495621 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f6eeb414-599c-4d7c-b555-c12b258cef71 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:02.496158 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f6eeb414-599c-4d7c-b555-c12b258cef71 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:02.496602 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f6eeb414-599c-4d7c-b555-c12b258cef71 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:02.497360 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f6eeb414-599c-4d7c-b555-c12b258cef71 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:02.497815 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f6eeb414-599c-4d7c-b555-c12b258cef71 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:02.498309 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f6eeb414-599c-4d7c-b555-c12b258cef71 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:02.755194 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-86262e21-1884-4f3f-9d40-1a000bd43407 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9dbe3b7fdd482681b6ab94c26f4e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d394882f294c6283721bcc6f8ff04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:12:02.765320 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-86262e21-1884-4f3f-9d40-1a000bd43407 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "GET /compute/v2.1/servers/d1cc9961-0393-433e-9c87-cdd2b8457a85" status: 200 len: 1577 microversion: 2.1 time: 0.568374 Aug 11 11:12:02.771881 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 495/976] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:12:02 2022] GET /compute/v2.1/servers/d1cc9961-0393-433e-9c87-cdd2b8457a85 => generated 1577 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:12:02.842422 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-f6eeb414-599c-4d7c-b555-c12b258cef71 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08d81bcd5a4f43ce8b4839ee15cb163b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56bd2a662e34a6395117027b5c28c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:12:02.850786 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-f6eeb414-599c-4d7c-b555-c12b258cef71 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/fce2ee6c-537a-46d3-978e-92597b2c2931" status: 200 len: 1682 microversion: 2.1 time: 0.371564 Aug 11 11:12:02.864915 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 482/977] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:12:02 2022] GET /compute/v2.1/servers/fce2ee6c-537a-46d3-978e-92597b2c2931 => generated 1682 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:12:03.596196 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-a7668bb8-ef1c-4654-9524-e92c157da98e req-456cd6f8-0515-45b6-be6b-a6540b9bfa59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1cc9961-0393-433e-9c87-cdd2b8457a85", "name": "network-vif-deleted", "tag": "965e09f5-4bf9-4eeb-b7ca-f1b072b67e41"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:12:03.613693 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-a7668bb8-ef1c-4654-9524-e92c157da98e req-456cd6f8-0515-45b6-be6b-a6540b9bfa59 service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:03.613693 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-a7668bb8-ef1c-4654-9524-e92c157da98e req-456cd6f8-0515-45b6-be6b-a6540b9bfa59 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:03.613693 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-a7668bb8-ef1c-4654-9524-e92c157da98e req-456cd6f8-0515-45b6-be6b-a6540b9bfa59 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:03.629476 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-a7668bb8-ef1c-4654-9524-e92c157da98e req-456cd6f8-0515-45b6-be6b-a6540b9bfa59 service nova] Creating event network-vif-deleted:965e09f5-4bf9-4eeb-b7ca-f1b072b67e41 for instance d1cc9961-0393-433e-9c87-cdd2b8457a85 on hv-cinder-82002 Aug 11 11:12:03.636015 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-a7668bb8-ef1c-4654-9524-e92c157da98e req-456cd6f8-0515-45b6-be6b-a6540b9bfa59 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052737 Aug 11 11:12:03.637348 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 496/978] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:12:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:12:03.652453 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-b7cc2a2d-dbf5-4bd2-a8ad-14db6fbff21a req-56936399-dc42-48b0-9085-dc73b5091c3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fce2ee6c-537a-46d3-978e-92597b2c2931", "name": "network-vif-deleted", "tag": "3fc3df13-de91-4827-8c01-98f38098bdeb"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:12:03.672698 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-b7cc2a2d-dbf5-4bd2-a8ad-14db6fbff21a req-56936399-dc42-48b0-9085-dc73b5091c3a service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:03.674201 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-b7cc2a2d-dbf5-4bd2-a8ad-14db6fbff21a req-56936399-dc42-48b0-9085-dc73b5091c3a service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:03.674834 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-b7cc2a2d-dbf5-4bd2-a8ad-14db6fbff21a req-56936399-dc42-48b0-9085-dc73b5091c3a service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:03.689626 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-b7cc2a2d-dbf5-4bd2-a8ad-14db6fbff21a req-56936399-dc42-48b0-9085-dc73b5091c3a service nova] Creating event network-vif-deleted:3fc3df13-de91-4827-8c01-98f38098bdeb for instance fce2ee6c-537a-46d3-978e-92597b2c2931 on hv-cinder-82002 Aug 11 11:12:03.703118 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-b7cc2a2d-dbf5-4bd2-a8ad-14db6fbff21a req-56936399-dc42-48b0-9085-dc73b5091c3a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056537 Aug 11 11:12:03.706508 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 483/979] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:12:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:12:03.791522 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-97647764-d2a0-4265-b487-3a2bd604f92e tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:12:03.792474 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-97647764-d2a0-4265-b487-3a2bd604f92e tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: d1cc9961-0393-433e-9c87-cdd2b8457a85] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:12:03.808486 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-97647764-d2a0-4265-b487-3a2bd604f92e tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:03.809743 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-97647764-d2a0-4265-b487-3a2bd604f92e tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:03.810329 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-97647764-d2a0-4265-b487-3a2bd604f92e tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:03.811066 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-97647764-d2a0-4265-b487-3a2bd604f92e tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:03.811520 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-97647764-d2a0-4265-b487-3a2bd604f92e tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:03.814501 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-97647764-d2a0-4265-b487-3a2bd604f92e tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:03.875408 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-e84f0fb0-262e-4900-8898-97b69f355978 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:12:03.883742 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-e84f0fb0-262e-4900-8898-97b69f355978 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: fce2ee6c-537a-46d3-978e-92597b2c2931] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:12:03.894686 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e84f0fb0-262e-4900-8898-97b69f355978 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:03.895373 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e84f0fb0-262e-4900-8898-97b69f355978 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:03.895860 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e84f0fb0-262e-4900-8898-97b69f355978 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:03.900842 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e84f0fb0-262e-4900-8898-97b69f355978 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:03.901894 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e84f0fb0-262e-4900-8898-97b69f355978 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:03.903337 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e84f0fb0-262e-4900-8898-97b69f355978 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:03.957976 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-97647764-d2a0-4265-b487-3a2bd604f92e tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9dbe3b7fdd482681b6ab94c26f4e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d394882f294c6283721bcc6f8ff04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:12:03.968896 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-97647764-d2a0-4265-b487-3a2bd604f92e tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "GET /compute/v2.1/servers/d1cc9961-0393-433e-9c87-cdd2b8457a85" status: 200 len: 1224 microversion: 2.1 time: 0.182960 Aug 11 11:12:03.970366 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 497/980] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:12:03 2022] GET /compute/v2.1/servers/d1cc9961-0393-433e-9c87-cdd2b8457a85 => generated 1224 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:12:04.075645 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-e84f0fb0-262e-4900-8898-97b69f355978 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08d81bcd5a4f43ce8b4839ee15cb163b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56bd2a662e34a6395117027b5c28c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:12:04.086233 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-e84f0fb0-262e-4900-8898-97b69f355978 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/fce2ee6c-537a-46d3-978e-92597b2c2931" status: 200 len: 1327 microversion: 2.1 time: 0.217448 Aug 11 11:12:04.100240 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 484/981] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:12:03 2022] GET /compute/v2.1/servers/fce2ee6c-537a-46d3-978e-92597b2c2931 => generated 1327 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:12:04.998855 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-f0b833b1-2e7c-4bcf-bebf-2cb30ab3c688 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:12:04.999461 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-f0b833b1-2e7c-4bcf-bebf-2cb30ab3c688 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: d1cc9961-0393-433e-9c87-cdd2b8457a85] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:12:05.008986 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f0b833b1-2e7c-4bcf-bebf-2cb30ab3c688 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:05.008986 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f0b833b1-2e7c-4bcf-bebf-2cb30ab3c688 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:05.008986 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f0b833b1-2e7c-4bcf-bebf-2cb30ab3c688 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:05.009581 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f0b833b1-2e7c-4bcf-bebf-2cb30ab3c688 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:05.009748 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f0b833b1-2e7c-4bcf-bebf-2cb30ab3c688 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:05.010411 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f0b833b1-2e7c-4bcf-bebf-2cb30ab3c688 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:05.055009 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f0b833b1-2e7c-4bcf-bebf-2cb30ab3c688 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:05.055630 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f0b833b1-2e7c-4bcf-bebf-2cb30ab3c688 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:05.056252 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f0b833b1-2e7c-4bcf-bebf-2cb30ab3c688 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:05.056821 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.objects.instance [None req-f0b833b1-2e7c-4bcf-bebf-2cb30ab3c688 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lazy-loading 'fault' on Instance uuid d1cc9961-0393-433e-9c87-cdd2b8457a85 {{(pid=121232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 11:12:05.110148 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-4b1eb5b7-6228-4b6f-94d1-b85d7ad133bd tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:12:05.110850 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-4b1eb5b7-6228-4b6f-94d1-b85d7ad133bd tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: fce2ee6c-537a-46d3-978e-92597b2c2931] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:12:05.121053 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-f0b833b1-2e7c-4bcf-bebf-2cb30ab3c688 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9dbe3b7fdd482681b6ab94c26f4e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d394882f294c6283721bcc6f8ff04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:12:05.125141 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4b1eb5b7-6228-4b6f-94d1-b85d7ad133bd tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:05.125141 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4b1eb5b7-6228-4b6f-94d1-b85d7ad133bd tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:05.125510 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4b1eb5b7-6228-4b6f-94d1-b85d7ad133bd tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:05.125948 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4b1eb5b7-6228-4b6f-94d1-b85d7ad133bd tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:05.127524 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4b1eb5b7-6228-4b6f-94d1-b85d7ad133bd tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:05.127990 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4b1eb5b7-6228-4b6f-94d1-b85d7ad133bd tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:05.131918 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-f0b833b1-2e7c-4bcf-bebf-2cb30ab3c688 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "GET /compute/v2.1/servers/d1cc9961-0393-433e-9c87-cdd2b8457a85" status: 200 len: 1229 microversion: 2.1 time: 0.139153 Aug 11 11:12:05.132492 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 498/982] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:12:04 2022] GET /compute/v2.1/servers/d1cc9961-0393-433e-9c87-cdd2b8457a85 => generated 1229 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:12:05.246093 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4b1eb5b7-6228-4b6f-94d1-b85d7ad133bd tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:05.246873 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4b1eb5b7-6228-4b6f-94d1-b85d7ad133bd tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:05.247490 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4b1eb5b7-6228-4b6f-94d1-b85d7ad133bd tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:05.263712 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.objects.instance [None req-4b1eb5b7-6228-4b6f-94d1-b85d7ad133bd tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lazy-loading 'fault' on Instance uuid fce2ee6c-537a-46d3-978e-92597b2c2931 {{(pid=121231) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 11:12:05.332138 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-4b1eb5b7-6228-4b6f-94d1-b85d7ad133bd tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08d81bcd5a4f43ce8b4839ee15cb163b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56bd2a662e34a6395117027b5c28c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:12:05.341210 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-4b1eb5b7-6228-4b6f-94d1-b85d7ad133bd tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/fce2ee6c-537a-46d3-978e-92597b2c2931" status: 200 len: 1332 microversion: 2.1 time: 0.235507 Aug 11 11:12:05.341775 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 485/983] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:12:05 2022] GET /compute/v2.1/servers/fce2ee6c-537a-46d3-978e-92597b2c2931 => generated 1332 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:12:06.153684 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-1acac599-426b-4502-b92f-cba164013597 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:12:06.154287 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-1acac599-426b-4502-b92f-cba164013597 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: d1cc9961-0393-433e-9c87-cdd2b8457a85] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:12:06.161951 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1acac599-426b-4502-b92f-cba164013597 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:06.162449 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1acac599-426b-4502-b92f-cba164013597 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:06.162877 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1acac599-426b-4502-b92f-cba164013597 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:06.163572 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1acac599-426b-4502-b92f-cba164013597 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:06.164054 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1acac599-426b-4502-b92f-cba164013597 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:06.164472 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1acac599-426b-4502-b92f-cba164013597 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:06.178374 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.wsgi [None req-1acac599-426b-4502-b92f-cba164013597 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] HTTP exception thrown: Instance d1cc9961-0393-433e-9c87-cdd2b8457a85 could not be found. Aug 11 11:12:06.180044 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-1acac599-426b-4502-b92f-cba164013597 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Request method failure captured: Aug 11 11:12:06.180044 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: request: GET /compute/v2.1/servers/d1cc9961-0393-433e-9c87-cdd2b8457a85 HTTP/1.1 Aug 11 11:12:06.180044 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Accept: application/json Aug 11 11:12:06.180044 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Accept-Encoding: identity Aug 11 11:12:06.180044 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Connection: close Aug 11 11:12:06.180044 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Content-Length: 0 Aug 11 11:12:06.180044 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Content-Type: application/json Aug 11 11:12:06.180044 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Host: 10.222.0.48 Aug 11 11:12:06.180044 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Openstack-System-Scope: None Aug 11 11:12:06.180044 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: User-Agent: python-urllib3/1.26.11 Aug 11 11:12:06.180044 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Auth-Token: gAAAAABi9ONDFF-ves-CEGtHwEi0XWUKyyde7tb-EmhLfOVMkLk-S6BaYvZIZyro-ToFwRU2ksjzyOGpMhm8jPNnMcZc2yErCXhJsj5bK4F2r0o8vxP0k2UPPpT-E6--5k2jWa36MkdUrOHa4cUapXKrNjZGlMmImRY0M-OdlgiV64MA5NWcgec Aug 11 11:12:06.180044 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Domain-Id: None Aug 11 11:12:06.180044 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Domain-Name: None Aug 11 11:12:06.180044 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Identity-Status: Confirmed Aug 11 11:12:06.180044 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Is-Admin-Project: True Aug 11 11:12:06.180044 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Domain-Id: default Aug 11 11:12:06.180044 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Domain-Name: Default Aug 11 11:12:06.180044 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Id: b1d394882f294c6283721bcc6f8ff04d Aug 11 11:12:06.180044 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Name: tempest-TestVolumeBootPattern-469230006 Aug 11 11:12:06.180044 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Role: reader,member Aug 11 11:12:06.180044 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Roles: reader,member Aug 11 11:12:06.181743 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b1d394882f294c6283721bcc6f8ff04d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b1d394882f294c6283721bcc6f8ff04d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b1d394882f294c6283721bcc6f8ff04d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b1d394882f294c6283721bcc6f8ff04d", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] Aug 11 11:12:06.181743 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Tenant: tempest-TestVolumeBootPattern-469230006 Aug 11 11:12:06.181743 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Tenant-Id: b1d394882f294c6283721bcc6f8ff04d Aug 11 11:12:06.181743 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Tenant-Name: tempest-TestVolumeBootPattern-469230006 Aug 11 11:12:06.181743 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User: tempest-TestVolumeBootPattern-469230006-project Aug 11 11:12:06.181743 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Domain-Id: default Aug 11 11:12:06.181743 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Domain-Name: Default Aug 11 11:12:06.181743 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Id: 2a9dbe3b7fdd482681b6ab94c26f4e71 Aug 11 11:12:06.181743 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Name: tempest-TestVolumeBootPattern-469230006-project Aug 11 11:12:06.181743 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: method: > Aug 11 11:12:06.181743 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: exception: Instance d1cc9961-0393-433e-9c87-cdd2b8457a85 could not be found. Aug 11 11:12:06.181743 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: action_args: {'id': 'd1cc9961-0393-433e-9c87-cdd2b8457a85'} Aug 11 11:12:06.182685 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 11:12:06.182685 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:12:06.182685 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 11:12:06.182685 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 11:12:06.182685 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 11:12:06.182685 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 11:12:06.182685 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 11:12:06.182685 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 11:12:06.182685 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 11:12:06.182685 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 11:12:06.182685 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1cc9961-0393-433e-9c87-cdd2b8457a85 could not be found. Aug 11 11:12:06.182685 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:12:06.182685 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:12:06.182685 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:12:06.182685 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:12:06.182685 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:12:06.182685 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:12:06.182685 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 11:12:06.182685 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 11:12:06.182685 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 11:12:06.184257 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 11:12:06.184257 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 11:12:06.184257 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 11:12:06.184257 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 11:12:06.184257 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 11:12:06.184257 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 11:12:06.184257 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 11:12:06.184257 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1cc9961-0393-433e-9c87-cdd2b8457a85 could not be found. Aug 11 11:12:06.184257 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:12:06.184257 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:12:06.184257 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:12:06.184257 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:12:06.184257 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:12:06.184257 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:12:06.184257 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 11:12:06.184257 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 11:12:06.184257 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1cc9961-0393-433e-9c87-cdd2b8457a85 could not be found. Aug 11 11:12:06.184257 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:12:06.185673 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-1acac599-426b-4502-b92f-cba164013597 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Returning 404 to user: Instance d1cc9961-0393-433e-9c87-cdd2b8457a85 could not be found. {{(pid=121232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 11:12:06.185673 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-1acac599-426b-4502-b92f-cba164013597 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "GET /compute/v2.1/servers/d1cc9961-0393-433e-9c87-cdd2b8457a85" status: 404 len: 111 microversion: 2.1 time: 0.031834 Aug 11 11:12:06.185673 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 499/984] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:12:06 2022] GET /compute/v2.1/servers/d1cc9961-0393-433e-9c87-cdd2b8457a85 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 11:12:06.331509 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-712a1e66-020d-4469-892e-788fc940dede tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1742052885", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-614059539", "security_groups": [{"name": "tempest-secgroup-smoke-879638545"}], "block_device_mapping_v2": [{"uuid": "ce5edff3-29c9-4c64-a8ef-4685e9aa2684", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1386703a-61b7-4e13-98b7-ce04b934949c"}]}} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:12:06.363598 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-6f74c113-723f-44b4-86c0-2c38d28a4098 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:12:06.364239 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-6f74c113-723f-44b4-86c0-2c38d28a4098 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: fce2ee6c-537a-46d3-978e-92597b2c2931] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:12:06.370688 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6f74c113-723f-44b4-86c0-2c38d28a4098 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:06.371298 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6f74c113-723f-44b4-86c0-2c38d28a4098 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:06.371578 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6f74c113-723f-44b4-86c0-2c38d28a4098 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:06.372288 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6f74c113-723f-44b4-86c0-2c38d28a4098 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:06.372737 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6f74c113-723f-44b4-86c0-2c38d28a4098 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:06.373250 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6f74c113-723f-44b4-86c0-2c38d28a4098 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:06.389411 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.wsgi [None req-6f74c113-723f-44b4-86c0-2c38d28a4098 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] HTTP exception thrown: Instance fce2ee6c-537a-46d3-978e-92597b2c2931 could not be found. Aug 11 11:12:06.390943 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-6f74c113-723f-44b4-86c0-2c38d28a4098 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Request method failure captured: Aug 11 11:12:06.390943 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: request: GET /compute/v2.1/servers/fce2ee6c-537a-46d3-978e-92597b2c2931 HTTP/1.1 Aug 11 11:12:06.390943 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Accept: application/json Aug 11 11:12:06.390943 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Accept-Encoding: identity Aug 11 11:12:06.390943 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Connection: close Aug 11 11:12:06.390943 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Content-Length: 0 Aug 11 11:12:06.390943 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Content-Type: application/json Aug 11 11:12:06.390943 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Host: 10.222.0.48 Aug 11 11:12:06.390943 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Openstack-System-Scope: None Aug 11 11:12:06.390943 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: User-Agent: python-urllib3/1.26.11 Aug 11 11:12:06.390943 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Auth-Token: gAAAAABi9ONxPYWpRmadpANSM5f1tl1wVESW1SFE62fiY511YI9uU6D_79r-yuQvgjKjvFqPWeHAiFZFw3kYac2M1zqDX4QPozx6rX_pgfB-Fgz47x90y_mKI7zGyyPs8EkLoYDiomkPvd5a4fE5iPsTlEJ3RRgCL7XDnuCGisjN8PsW1aCU_y4 Aug 11 11:12:06.390943 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Domain-Id: None Aug 11 11:12:06.390943 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Domain-Name: None Aug 11 11:12:06.390943 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Identity-Status: Confirmed Aug 11 11:12:06.390943 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Is-Admin-Project: True Aug 11 11:12:06.390943 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Domain-Id: default Aug 11 11:12:06.390943 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Domain-Name: Default Aug 11 11:12:06.390943 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Id: c56bd2a662e34a6395117027b5c28c5b Aug 11 11:12:06.390943 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Name: tempest-AttachVolumeNegativeTest-848160622 Aug 11 11:12:06.390943 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Role: reader,member Aug 11 11:12:06.390943 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Roles: reader,member Aug 11 11:12:06.392370 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c56bd2a662e34a6395117027b5c28c5b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c56bd2a662e34a6395117027b5c28c5b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c56bd2a662e34a6395117027b5c28c5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c56bd2a662e34a6395117027b5c28c5b", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] Aug 11 11:12:06.392370 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Tenant: tempest-AttachVolumeNegativeTest-848160622 Aug 11 11:12:06.392370 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Tenant-Id: c56bd2a662e34a6395117027b5c28c5b Aug 11 11:12:06.392370 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-848160622 Aug 11 11:12:06.392370 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User: tempest-AttachVolumeNegativeTest-848160622-project Aug 11 11:12:06.392370 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Domain-Id: default Aug 11 11:12:06.392370 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Domain-Name: Default Aug 11 11:12:06.392370 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Id: 08d81bcd5a4f43ce8b4839ee15cb163b Aug 11 11:12:06.392370 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Name: tempest-AttachVolumeNegativeTest-848160622-project Aug 11 11:12:06.392370 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: method: > Aug 11 11:12:06.392370 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: exception: Instance fce2ee6c-537a-46d3-978e-92597b2c2931 could not be found. Aug 11 11:12:06.392370 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: action_args: {'id': 'fce2ee6c-537a-46d3-978e-92597b2c2931'} Aug 11 11:12:06.393161 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 11:12:06.393161 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:12:06.393161 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 11:12:06.393161 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 11:12:06.393161 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 11:12:06.393161 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 11:12:06.393161 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 11:12:06.393161 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 11:12:06.393161 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 11:12:06.393161 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 11:12:06.393161 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fce2ee6c-537a-46d3-978e-92597b2c2931 could not be found. Aug 11 11:12:06.393161 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:12:06.393161 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:12:06.393161 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:12:06.393161 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:12:06.393161 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:12:06.393161 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:12:06.393161 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 11:12:06.393161 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 11:12:06.393161 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 11:12:06.394448 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 11:12:06.394448 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 11:12:06.394448 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 11:12:06.394448 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 11:12:06.394448 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 11:12:06.394448 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 11:12:06.394448 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 11:12:06.394448 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fce2ee6c-537a-46d3-978e-92597b2c2931 could not be found. Aug 11 11:12:06.394448 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:12:06.394448 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:12:06.394448 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:12:06.394448 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:12:06.394448 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:12:06.394448 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:12:06.394448 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 11:12:06.394448 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 11:12:06.394448 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fce2ee6c-537a-46d3-978e-92597b2c2931 could not be found. Aug 11 11:12:06.394448 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:12:06.395603 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-6f74c113-723f-44b4-86c0-2c38d28a4098 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Returning 404 to user: Instance fce2ee6c-537a-46d3-978e-92597b2c2931 could not be found. {{(pid=121232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 11:12:06.395603 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-6f74c113-723f-44b4-86c0-2c38d28a4098 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/fce2ee6c-537a-46d3-978e-92597b2c2931" status: 404 len: 111 microversion: 2.1 time: 0.032567 Aug 11 11:12:06.395603 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 500/985] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:12:06 2022] GET /compute/v2.1/servers/fce2ee6c-537a-46d3-978e-92597b2c2931 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 11 11:12:06.404637 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-279bb3a6-67b3-4d9d-b89a-22b4ac944431 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '.version_select at 0x7faab0b21940>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:12:06.475635 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.network.neutron [None req-712a1e66-020d-4469-892e-788fc940dede tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] validate_networks() for [('1386703a-61b7-4e13-98b7-ce04b934949c', None, None, None, None, None)] {{(pid=121231) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 11 11:12:06.477641 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-279bb3a6-67b3-4d9d-b89a-22b4ac944431 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1906300238" status: 202 len: 0 microversion: 2.1 time: 0.079348 Aug 11 11:12:06.477785 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 501/986] 10.222.0.48 () {58 vars in 1221 bytes} [Thu Aug 11 11:12:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1906300238 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 11:12:07.063962 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-712a1e66-020d-4469-892e-788fc940dede tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Flavor limits 0:0:0 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 11 11:12:07.064713 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-712a1e66-020d-4469-892e-788fc940dede tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Image limits 0:0:0 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 11 11:12:07.066227 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-712a1e66-020d-4469-892e-788fc940dede tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Flavor pref 0:0:0 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 11 11:12:07.066866 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-712a1e66-020d-4469-892e-788fc940dede tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Image pref 0:0:0 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 11 11:12:07.067501 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-712a1e66-020d-4469-892e-788fc940dede tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 11 11:12:07.082421 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-712a1e66-020d-4469-892e-788fc940dede tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:07.083160 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-712a1e66-020d-4469-892e-788fc940dede tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:07.084166 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-712a1e66-020d-4469-892e-788fc940dede tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:07.085919 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-712a1e66-020d-4469-892e-788fc940dede tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:07.086721 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-712a1e66-020d-4469-892e-788fc940dede tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:07.087650 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-712a1e66-020d-4469-892e-788fc940dede tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:07.119713 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.quota [None req-712a1e66-020d-4469-892e-788fc940dede tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Getting quotas for project b1d394882f294c6283721bcc6f8ff04d. Resources: {'ram', 'cores', 'instances'} {{(pid=121231) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 11:12:07.125823 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.quota [None req-712a1e66-020d-4469-892e-788fc940dede tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Getting quotas for user 2a9dbe3b7fdd482681b6ab94c26f4e71 and project b1d394882f294c6283721bcc6f8ff04d. Resources: {'ram', 'cores', 'instances'} {{(pid=121231) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 11:12:07.195755 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-712a1e66-020d-4469-892e-788fc940dede tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Going to run 1 instances... {{(pid=121231) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 11 11:12:07.197920 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-712a1e66-020d-4469-892e-788fc940dede tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: 6775b84f-c318-4b37-9fdf-e93e607dfa4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ce5edff3-29c9-4c64-a8ef-4685e9aa2684',volume_size=None,volume_type=None)] {{(pid=121231) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 11 11:12:07.525017 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-cbab104d-6e24-49fa-ae59-c7333838e127 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:12:07.525538 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-cbab104d-6e24-49fa-ae59-c7333838e127 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: f6bf35b3-de6a-41ae-81b7-8f45852ab5e2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:12:07.532569 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cbab104d-6e24-49fa-ae59-c7333838e127 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:07.533191 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cbab104d-6e24-49fa-ae59-c7333838e127 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:07.533629 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cbab104d-6e24-49fa-ae59-c7333838e127 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:07.534311 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cbab104d-6e24-49fa-ae59-c7333838e127 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:07.534754 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cbab104d-6e24-49fa-ae59-c7333838e127 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:07.535170 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cbab104d-6e24-49fa-ae59-c7333838e127 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:07.569710 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-712a1e66-020d-4469-892e-788fc940dede tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.242071 Aug 11 11:12:07.570946 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 486/987] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Aug 11 11:12:06 2022] POST /compute/v2.1/servers => generated 405 bytes in 1244 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 11 11:12:07.582206 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-798f707d-572f-4880-b6bb-b6367a9759b5 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:12:07.583012 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-798f707d-572f-4880-b6bb-b6367a9759b5 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: 6775b84f-c318-4b37-9fdf-e93e607dfa4e] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:12:07.660020 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-798f707d-572f-4880-b6bb-b6367a9759b5 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9dbe3b7fdd482681b6ab94c26f4e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d394882f294c6283721bcc6f8ff04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:12:07.663921 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.objects.instance [None req-cbab104d-6e24-49fa-ae59-c7333838e127 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lazy-loading 'services' on Instance uuid f6bf35b3-de6a-41ae-81b7-8f45852ab5e2 {{(pid=121232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 11:12:07.668510 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-798f707d-572f-4880-b6bb-b6367a9759b5 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "GET /compute/v2.1/servers/6775b84f-c318-4b37-9fdf-e93e607dfa4e" status: 200 len: 1094 microversion: 2.1 time: 0.090250 Aug 11 11:12:07.669087 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 487/988] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:12:07 2022] GET /compute/v2.1/servers/6775b84f-c318-4b37-9fdf-e93e607dfa4e => generated 1094 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:12:07.909390 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-cbab104d-6e24-49fa-ae59-c7333838e127 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f6bf35b3-de6a-41ae-81b7-8f45852ab5e2/os-volume_attachments/d4cc7e22-b71a-4add-958c-8af923db7fa5" status: 202 len: 0 microversion: 2.1 time: 0.389176 Aug 11 11:12:07.910145 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 502/989] 10.222.0.48 () {58 vars in 1416 bytes} [Thu Aug 11 11:12:07 2022] DELETE /compute/v2.1/servers/f6bf35b3-de6a-41ae-81b7-8f45852ab5e2/os-volume_attachments/d4cc7e22-b71a-4add-958c-8af923db7fa5 => generated 0 bytes in 391 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 11:12:07.920529 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-c6cad006-6189-4e02-a075-8fe6542d13b2 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:12:07.922888 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-c6cad006-6189-4e02-a075-8fe6542d13b2 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: f6bf35b3-de6a-41ae-81b7-8f45852ab5e2] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:12:07.930257 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c6cad006-6189-4e02-a075-8fe6542d13b2 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:07.930742 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c6cad006-6189-4e02-a075-8fe6542d13b2 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:07.931177 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c6cad006-6189-4e02-a075-8fe6542d13b2 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:07.931902 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c6cad006-6189-4e02-a075-8fe6542d13b2 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:07.932352 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c6cad006-6189-4e02-a075-8fe6542d13b2 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:07.932769 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c6cad006-6189-4e02-a075-8fe6542d13b2 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:07.966423 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-c6cad006-6189-4e02-a075-8fe6542d13b2 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/f6bf35b3-de6a-41ae-81b7-8f45852ab5e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050663 Aug 11 11:12:07.967271 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 488/990] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Aug 11 11:12:07 2022] GET /compute/v2.1/servers/f6bf35b3-de6a-41ae-81b7-8f45852ab5e2/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:12:08.691813 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-2a05d5b8-a74a-433f-b3e8-e19bb4cbff16 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:12:08.691813 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-2a05d5b8-a74a-433f-b3e8-e19bb4cbff16 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: 6775b84f-c318-4b37-9fdf-e93e607dfa4e] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:12:08.698122 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2a05d5b8-a74a-433f-b3e8-e19bb4cbff16 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:08.698664 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2a05d5b8-a74a-433f-b3e8-e19bb4cbff16 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:08.699097 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2a05d5b8-a74a-433f-b3e8-e19bb4cbff16 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:08.699798 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2a05d5b8-a74a-433f-b3e8-e19bb4cbff16 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:08.700253 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2a05d5b8-a74a-433f-b3e8-e19bb4cbff16 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:08.700697 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2a05d5b8-a74a-433f-b3e8-e19bb4cbff16 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:08.765187 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-2a05d5b8-a74a-433f-b3e8-e19bb4cbff16 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9dbe3b7fdd482681b6ab94c26f4e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d394882f294c6283721bcc6f8ff04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:12:08.773567 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-2a05d5b8-a74a-433f-b3e8-e19bb4cbff16 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "GET /compute/v2.1/servers/6775b84f-c318-4b37-9fdf-e93e607dfa4e" status: 200 len: 1144 microversion: 2.1 time: 0.086990 Aug 11 11:12:08.774142 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 503/991] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:12:08 2022] GET /compute/v2.1/servers/6775b84f-c318-4b37-9fdf-e93e607dfa4e => generated 1144 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:12:08.981086 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-417a87cb-6266-43d6-a209-172c2208428d tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:12:08.983249 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-417a87cb-6266-43d6-a209-172c2208428d tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: f6bf35b3-de6a-41ae-81b7-8f45852ab5e2] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:12:08.989195 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-417a87cb-6266-43d6-a209-172c2208428d tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:08.989676 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-417a87cb-6266-43d6-a209-172c2208428d tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:08.990748 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-417a87cb-6266-43d6-a209-172c2208428d tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:08.991461 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-417a87cb-6266-43d6-a209-172c2208428d tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:08.991940 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-417a87cb-6266-43d6-a209-172c2208428d tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:08.992358 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-417a87cb-6266-43d6-a209-172c2208428d tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:09.026389 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-417a87cb-6266-43d6-a209-172c2208428d tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/f6bf35b3-de6a-41ae-81b7-8f45852ab5e2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045279 Aug 11 11:12:09.026389 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 489/992] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Aug 11 11:12:08 2022] GET /compute/v2.1/servers/f6bf35b3-de6a-41ae-81b7-8f45852ab5e2/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:12:09.794597 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-5f0b2ab8-f86b-4b15-bc56-a08aeefe266a tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:12:09.795366 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-5f0b2ab8-f86b-4b15-bc56-a08aeefe266a tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: 6775b84f-c318-4b37-9fdf-e93e607dfa4e] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:12:09.801745 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5f0b2ab8-f86b-4b15-bc56-a08aeefe266a tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:09.802248 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5f0b2ab8-f86b-4b15-bc56-a08aeefe266a tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:09.802686 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5f0b2ab8-f86b-4b15-bc56-a08aeefe266a tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:09.803443 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5f0b2ab8-f86b-4b15-bc56-a08aeefe266a tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:09.803995 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5f0b2ab8-f86b-4b15-bc56-a08aeefe266a tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:09.804419 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5f0b2ab8-f86b-4b15-bc56-a08aeefe266a tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:09.903184 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-5f0b2ab8-f86b-4b15-bc56-a08aeefe266a tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9dbe3b7fdd482681b6ab94c26f4e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d394882f294c6283721bcc6f8ff04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:12:09.911646 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-5f0b2ab8-f86b-4b15-bc56-a08aeefe266a tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "GET /compute/v2.1/servers/6775b84f-c318-4b37-9fdf-e93e607dfa4e" status: 200 len: 1192 microversion: 2.1 time: 0.120891 Aug 11 11:12:09.912356 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 504/993] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:12:09 2022] GET /compute/v2.1/servers/6775b84f-c318-4b37-9fdf-e93e607dfa4e => generated 1192 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:12:10.034174 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-a39481b7-a4ea-4f07-b45b-4f5e4dcbe493 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:12:10.036940 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-a39481b7-a4ea-4f07-b45b-4f5e4dcbe493 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: f6bf35b3-de6a-41ae-81b7-8f45852ab5e2] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:12:10.043734 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a39481b7-a4ea-4f07-b45b-4f5e4dcbe493 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:10.044287 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a39481b7-a4ea-4f07-b45b-4f5e4dcbe493 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:10.044737 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a39481b7-a4ea-4f07-b45b-4f5e4dcbe493 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:10.045451 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a39481b7-a4ea-4f07-b45b-4f5e4dcbe493 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:10.045907 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a39481b7-a4ea-4f07-b45b-4f5e4dcbe493 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:10.046351 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a39481b7-a4ea-4f07-b45b-4f5e4dcbe493 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:10.076957 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-a39481b7-a4ea-4f07-b45b-4f5e4dcbe493 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/f6bf35b3-de6a-41ae-81b7-8f45852ab5e2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046735 Aug 11 11:12:10.077594 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 490/994] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Aug 11 11:12:10 2022] GET /compute/v2.1/servers/f6bf35b3-de6a-41ae-81b7-8f45852ab5e2/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 11 11:12:10.140140 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-658c7029-9583-4c45-8511-28535ba75a11 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:12:10.152250 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-658c7029-9583-4c45-8511-28535ba75a11 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: f6bf35b3-de6a-41ae-81b7-8f45852ab5e2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:12:10.152250 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-658c7029-9583-4c45-8511-28535ba75a11 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:10.152250 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-658c7029-9583-4c45-8511-28535ba75a11 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:10.152250 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-658c7029-9583-4c45-8511-28535ba75a11 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:10.152690 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-658c7029-9583-4c45-8511-28535ba75a11 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:10.152690 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-658c7029-9583-4c45-8511-28535ba75a11 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:10.152690 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-658c7029-9583-4c45-8511-28535ba75a11 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:10.168596 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:12:10.175971 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-658c7029-9583-4c45-8511-28535ba75a11 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: f6bf35b3-de6a-41ae-81b7-8f45852ab5e2] Going to try to terminate instance {{(pid=121232) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 11 11:12:10.567562 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-658c7029-9583-4c45-8511-28535ba75a11 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f6bf35b3-de6a-41ae-81b7-8f45852ab5e2" status: 204 len: 0 microversion: 2.1 time: 0.430127 Aug 11 11:12:10.567562 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 505/995] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Aug 11 11:12:10 2022] DELETE /compute/v2.1/servers/f6bf35b3-de6a-41ae-81b7-8f45852ab5e2 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 11 11:12:10.575980 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-f4aabb58-1082-485a-90fc-9e97a940cdae tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:12:10.576594 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-f4aabb58-1082-485a-90fc-9e97a940cdae tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: f6bf35b3-de6a-41ae-81b7-8f45852ab5e2] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:12:10.583013 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f4aabb58-1082-485a-90fc-9e97a940cdae tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:10.584136 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f4aabb58-1082-485a-90fc-9e97a940cdae tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:10.584698 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f4aabb58-1082-485a-90fc-9e97a940cdae tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:10.585437 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f4aabb58-1082-485a-90fc-9e97a940cdae tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:10.585889 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f4aabb58-1082-485a-90fc-9e97a940cdae tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:10.586308 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f4aabb58-1082-485a-90fc-9e97a940cdae tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:10.797278 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-f4aabb58-1082-485a-90fc-9e97a940cdae tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08d81bcd5a4f43ce8b4839ee15cb163b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56bd2a662e34a6395117027b5c28c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:12:10.805426 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-f4aabb58-1082-485a-90fc-9e97a940cdae tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/f6bf35b3-de6a-41ae-81b7-8f45852ab5e2" status: 200 len: 1681 microversion: 2.1 time: 0.233478 Aug 11 11:12:10.806000 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 491/996] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:12:10 2022] GET /compute/v2.1/servers/f6bf35b3-de6a-41ae-81b7-8f45852ab5e2 => generated 1681 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:12:10.938655 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-87fdd43d-8d99-48c2-bc30-70491ddf03b8 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:12:10.939356 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-87fdd43d-8d99-48c2-bc30-70491ddf03b8 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: 6775b84f-c318-4b37-9fdf-e93e607dfa4e] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:12:10.958503 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-87fdd43d-8d99-48c2-bc30-70491ddf03b8 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:10.962038 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-87fdd43d-8d99-48c2-bc30-70491ddf03b8 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:10.962038 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-87fdd43d-8d99-48c2-bc30-70491ddf03b8 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:10.962038 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-87fdd43d-8d99-48c2-bc30-70491ddf03b8 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:10.962038 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-87fdd43d-8d99-48c2-bc30-70491ddf03b8 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:10.962616 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-87fdd43d-8d99-48c2-bc30-70491ddf03b8 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:11.041294 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-87fdd43d-8d99-48c2-bc30-70491ddf03b8 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9dbe3b7fdd482681b6ab94c26f4e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d394882f294c6283721bcc6f8ff04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:12:11.050154 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-87fdd43d-8d99-48c2-bc30-70491ddf03b8 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "GET /compute/v2.1/servers/6775b84f-c318-4b37-9fdf-e93e607dfa4e" status: 200 len: 1210 microversion: 2.1 time: 0.115778 Aug 11 11:12:11.051113 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 506/997] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:12:10 2022] GET /compute/v2.1/servers/6775b84f-c318-4b37-9fdf-e93e607dfa4e => generated 1210 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:12:11.828027 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-06cc9c4b-83f1-45e6-8c76-0ba0786f951c tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:12:11.828640 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-06cc9c4b-83f1-45e6-8c76-0ba0786f951c tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: f6bf35b3-de6a-41ae-81b7-8f45852ab5e2] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:12:11.836151 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-06cc9c4b-83f1-45e6-8c76-0ba0786f951c tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:11.836725 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-06cc9c4b-83f1-45e6-8c76-0ba0786f951c tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:11.837158 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-06cc9c4b-83f1-45e6-8c76-0ba0786f951c tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:11.837851 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-06cc9c4b-83f1-45e6-8c76-0ba0786f951c tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:11.838485 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-06cc9c4b-83f1-45e6-8c76-0ba0786f951c tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:11.838906 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-06cc9c4b-83f1-45e6-8c76-0ba0786f951c tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:11.966846 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-06cc9c4b-83f1-45e6-8c76-0ba0786f951c tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08d81bcd5a4f43ce8b4839ee15cb163b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56bd2a662e34a6395117027b5c28c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:12:11.974486 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-06cc9c4b-83f1-45e6-8c76-0ba0786f951c tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/f6bf35b3-de6a-41ae-81b7-8f45852ab5e2" status: 200 len: 1681 microversion: 2.1 time: 0.150663 Aug 11 11:12:11.975091 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 492/998] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:12:11 2022] GET /compute/v2.1/servers/f6bf35b3-de6a-41ae-81b7-8f45852ab5e2 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:12:12.074216 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-15483870-142b-4a6c-9550-e359a55b21f4 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:12:12.075414 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-15483870-142b-4a6c-9550-e359a55b21f4 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: 6775b84f-c318-4b37-9fdf-e93e607dfa4e] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:12:12.083781 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-15483870-142b-4a6c-9550-e359a55b21f4 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:12.084548 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-15483870-142b-4a6c-9550-e359a55b21f4 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:12.085060 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-15483870-142b-4a6c-9550-e359a55b21f4 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:12.085835 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-15483870-142b-4a6c-9550-e359a55b21f4 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:12.086295 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-15483870-142b-4a6c-9550-e359a55b21f4 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:12.086844 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-15483870-142b-4a6c-9550-e359a55b21f4 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:12.306629 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-15483870-142b-4a6c-9550-e359a55b21f4 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9dbe3b7fdd482681b6ab94c26f4e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d394882f294c6283721bcc6f8ff04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:12:12.314236 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-15483870-142b-4a6c-9550-e359a55b21f4 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "GET /compute/v2.1/servers/6775b84f-c318-4b37-9fdf-e93e607dfa4e" status: 200 len: 1277 microversion: 2.1 time: 0.244503 Aug 11 11:12:12.314889 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 507/999] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:12:12 2022] GET /compute/v2.1/servers/6775b84f-c318-4b37-9fdf-e93e607dfa4e => generated 1277 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:12:12.979737 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-21ca7c6a-aa07-47cd-93b7-1a66283c9e36 req-49b75493-4b11-4e17-87f8-55b8f500b85a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6775b84f-c318-4b37-9fdf-e93e607dfa4e", "tag": "05193d12-2729-4079-9c68-2950747232ad"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:12:12.990552 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-21ca7c6a-aa07-47cd-93b7-1a66283c9e36 req-49b75493-4b11-4e17-87f8-55b8f500b85a service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:12.991107 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-21ca7c6a-aa07-47cd-93b7-1a66283c9e36 req-49b75493-4b11-4e17-87f8-55b8f500b85a service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:12.991756 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-21ca7c6a-aa07-47cd-93b7-1a66283c9e36 req-49b75493-4b11-4e17-87f8-55b8f500b85a service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:12.994852 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-e591ef02-09cc-4ed2-87a2-4219f982b7de tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:12:12.995465 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-e591ef02-09cc-4ed2-87a2-4219f982b7de tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: f6bf35b3-de6a-41ae-81b7-8f45852ab5e2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:12:13.004731 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-21ca7c6a-aa07-47cd-93b7-1a66283c9e36 req-49b75493-4b11-4e17-87f8-55b8f500b85a service nova] Creating event network-changed:05193d12-2729-4079-9c68-2950747232ad for instance 6775b84f-c318-4b37-9fdf-e93e607dfa4e on hv-cinder-82002 Aug 11 11:12:13.005639 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e591ef02-09cc-4ed2-87a2-4219f982b7de tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:13.006658 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e591ef02-09cc-4ed2-87a2-4219f982b7de tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:13.007326 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e591ef02-09cc-4ed2-87a2-4219f982b7de tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:13.008187 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e591ef02-09cc-4ed2-87a2-4219f982b7de tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:13.016410 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e591ef02-09cc-4ed2-87a2-4219f982b7de tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:13.016410 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e591ef02-09cc-4ed2-87a2-4219f982b7de tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:13.021119 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-21ca7c6a-aa07-47cd-93b7-1a66283c9e36 req-49b75493-4b11-4e17-87f8-55b8f500b85a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044463 Aug 11 11:12:13.021918 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 493/1000] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:12:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:12:13.307567 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-e591ef02-09cc-4ed2-87a2-4219f982b7de tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08d81bcd5a4f43ce8b4839ee15cb163b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56bd2a662e34a6395117027b5c28c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:12:13.320669 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-e591ef02-09cc-4ed2-87a2-4219f982b7de tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/f6bf35b3-de6a-41ae-81b7-8f45852ab5e2" status: 200 len: 1681 microversion: 2.1 time: 0.328958 Aug 11 11:12:13.322515 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 508/1001] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:12:12 2022] GET /compute/v2.1/servers/f6bf35b3-de6a-41ae-81b7-8f45852ab5e2 => generated 1681 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:12:13.336057 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-56c1775f-25bb-4230-b134-e29b2812dfc2 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:12:13.336764 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-56c1775f-25bb-4230-b134-e29b2812dfc2 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: 6775b84f-c318-4b37-9fdf-e93e607dfa4e] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:12:13.343718 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-56c1775f-25bb-4230-b134-e29b2812dfc2 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:13.345082 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-56c1775f-25bb-4230-b134-e29b2812dfc2 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:13.345705 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-56c1775f-25bb-4230-b134-e29b2812dfc2 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:13.346573 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-56c1775f-25bb-4230-b134-e29b2812dfc2 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:13.347884 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-56c1775f-25bb-4230-b134-e29b2812dfc2 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:13.349126 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-56c1775f-25bb-4230-b134-e29b2812dfc2 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:13.535975 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-56c1775f-25bb-4230-b134-e29b2812dfc2 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9dbe3b7fdd482681b6ab94c26f4e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d394882f294c6283721bcc6f8ff04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:12:13.544711 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-56c1775f-25bb-4230-b134-e29b2812dfc2 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "GET /compute/v2.1/servers/6775b84f-c318-4b37-9fdf-e93e607dfa4e" status: 200 len: 1265 microversion: 2.1 time: 0.213846 Aug 11 11:12:13.545282 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 494/1002] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:12:13 2022] GET /compute/v2.1/servers/6775b84f-c318-4b37-9fdf-e93e607dfa4e => generated 1265 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:12:13.639827 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-bd1ba657-cce0-4874-abdb-e7d7ae7aceed req-fc14dc32-295c-49d9-b17f-8e800743646e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f6bf35b3-de6a-41ae-81b7-8f45852ab5e2", "name": "network-vif-deleted", "tag": "7a83ec92-6913-4b9e-8486-1780dc2138d5"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:12:13.657156 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-bd1ba657-cce0-4874-abdb-e7d7ae7aceed req-fc14dc32-295c-49d9-b17f-8e800743646e service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:13.657903 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-bd1ba657-cce0-4874-abdb-e7d7ae7aceed req-fc14dc32-295c-49d9-b17f-8e800743646e service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:13.660041 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-bd1ba657-cce0-4874-abdb-e7d7ae7aceed req-fc14dc32-295c-49d9-b17f-8e800743646e service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:13.694610 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-bd1ba657-cce0-4874-abdb-e7d7ae7aceed req-fc14dc32-295c-49d9-b17f-8e800743646e service nova] Creating event network-vif-deleted:7a83ec92-6913-4b9e-8486-1780dc2138d5 for instance f6bf35b3-de6a-41ae-81b7-8f45852ab5e2 on hv-cinder-82002 Aug 11 11:12:13.700282 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-bd1ba657-cce0-4874-abdb-e7d7ae7aceed req-fc14dc32-295c-49d9-b17f-8e800743646e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066223 Aug 11 11:12:13.706071 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 509/1003] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:12:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:12:14.347423 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-a330cc2d-1b50-48b8-8f27-4d34529dff04 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:12:14.347423 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-a330cc2d-1b50-48b8-8f27-4d34529dff04 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: f6bf35b3-de6a-41ae-81b7-8f45852ab5e2] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:12:14.351899 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a330cc2d-1b50-48b8-8f27-4d34529dff04 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:14.352339 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a330cc2d-1b50-48b8-8f27-4d34529dff04 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:14.352772 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a330cc2d-1b50-48b8-8f27-4d34529dff04 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:14.353460 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a330cc2d-1b50-48b8-8f27-4d34529dff04 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:14.353904 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a330cc2d-1b50-48b8-8f27-4d34529dff04 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:14.354589 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a330cc2d-1b50-48b8-8f27-4d34529dff04 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:14.358779 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell1:SELECT=100 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:12:14.388635 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a330cc2d-1b50-48b8-8f27-4d34529dff04 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:14.389122 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a330cc2d-1b50-48b8-8f27-4d34529dff04 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:14.389556 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a330cc2d-1b50-48b8-8f27-4d34529dff04 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:14.390006 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.objects.instance [None req-a330cc2d-1b50-48b8-8f27-4d34529dff04 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lazy-loading 'fault' on Instance uuid f6bf35b3-de6a-41ae-81b7-8f45852ab5e2 {{(pid=121231) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 11:12:14.431643 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-a330cc2d-1b50-48b8-8f27-4d34529dff04 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08d81bcd5a4f43ce8b4839ee15cb163b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56bd2a662e34a6395117027b5c28c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:12:14.439589 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-a330cc2d-1b50-48b8-8f27-4d34529dff04 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/f6bf35b3-de6a-41ae-81b7-8f45852ab5e2" status: 200 len: 1331 microversion: 2.1 time: 0.098752 Aug 11 11:12:14.440202 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 495/1004] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:12:14 2022] GET /compute/v2.1/servers/f6bf35b3-de6a-41ae-81b7-8f45852ab5e2 => generated 1331 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:12:14.568290 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-32bc22dc-2689-487a-9997-700623e5707d tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:12:14.569023 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-32bc22dc-2689-487a-9997-700623e5707d tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: 6775b84f-c318-4b37-9fdf-e93e607dfa4e] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:12:14.581477 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-32bc22dc-2689-487a-9997-700623e5707d tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:14.581971 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-32bc22dc-2689-487a-9997-700623e5707d tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:14.582406 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-32bc22dc-2689-487a-9997-700623e5707d tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:14.589726 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-32bc22dc-2689-487a-9997-700623e5707d tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:14.589726 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-32bc22dc-2689-487a-9997-700623e5707d tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:14.589726 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-32bc22dc-2689-487a-9997-700623e5707d tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:14.745711 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-32bc22dc-2689-487a-9997-700623e5707d tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9dbe3b7fdd482681b6ab94c26f4e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d394882f294c6283721bcc6f8ff04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:12:14.753551 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-32bc22dc-2689-487a-9997-700623e5707d tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "GET /compute/v2.1/servers/6775b84f-c318-4b37-9fdf-e93e607dfa4e" status: 200 len: 1265 microversion: 2.1 time: 0.190808 Aug 11 11:12:14.754118 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 510/1005] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:12:14 2022] GET /compute/v2.1/servers/6775b84f-c318-4b37-9fdf-e93e607dfa4e => generated 1265 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:12:15.461417 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-595610a4-7a5a-41a9-824b-d635efc07c24 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:12:15.462024 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-595610a4-7a5a-41a9-824b-d635efc07c24 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: f6bf35b3-de6a-41ae-81b7-8f45852ab5e2] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:12:15.468622 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-595610a4-7a5a-41a9-824b-d635efc07c24 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:15.469105 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-595610a4-7a5a-41a9-824b-d635efc07c24 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:15.469546 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-595610a4-7a5a-41a9-824b-d635efc07c24 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:15.470240 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-595610a4-7a5a-41a9-824b-d635efc07c24 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:15.470696 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-595610a4-7a5a-41a9-824b-d635efc07c24 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:15.471120 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-595610a4-7a5a-41a9-824b-d635efc07c24 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:15.490333 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.wsgi [None req-595610a4-7a5a-41a9-824b-d635efc07c24 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] HTTP exception thrown: Instance f6bf35b3-de6a-41ae-81b7-8f45852ab5e2 could not be found. Aug 11 11:12:15.490333 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-595610a4-7a5a-41a9-824b-d635efc07c24 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Request method failure captured: Aug 11 11:12:15.490333 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: request: GET /compute/v2.1/servers/f6bf35b3-de6a-41ae-81b7-8f45852ab5e2 HTTP/1.1 Aug 11 11:12:15.490333 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Accept: application/json Aug 11 11:12:15.490333 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Accept-Encoding: identity Aug 11 11:12:15.490333 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Connection: close Aug 11 11:12:15.490333 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Content-Length: 0 Aug 11 11:12:15.490333 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Content-Type: application/json Aug 11 11:12:15.490333 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Host: 10.222.0.48 Aug 11 11:12:15.490333 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Openstack-System-Scope: None Aug 11 11:12:15.490333 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: User-Agent: python-urllib3/1.26.11 Aug 11 11:12:15.490333 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Auth-Token: gAAAAABi9ONxPYWpRmadpANSM5f1tl1wVESW1SFE62fiY511YI9uU6D_79r-yuQvgjKjvFqPWeHAiFZFw3kYac2M1zqDX4QPozx6rX_pgfB-Fgz47x90y_mKI7zGyyPs8EkLoYDiomkPvd5a4fE5iPsTlEJ3RRgCL7XDnuCGisjN8PsW1aCU_y4 Aug 11 11:12:15.490333 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Domain-Id: None Aug 11 11:12:15.490333 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Domain-Name: None Aug 11 11:12:15.490333 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Identity-Status: Confirmed Aug 11 11:12:15.490333 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Is-Admin-Project: True Aug 11 11:12:15.490333 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Domain-Id: default Aug 11 11:12:15.490333 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Domain-Name: Default Aug 11 11:12:15.490333 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Id: c56bd2a662e34a6395117027b5c28c5b Aug 11 11:12:15.490333 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Name: tempest-AttachVolumeNegativeTest-848160622 Aug 11 11:12:15.490333 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Role: reader,member Aug 11 11:12:15.490333 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Roles: reader,member Aug 11 11:12:15.493283 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c56bd2a662e34a6395117027b5c28c5b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c56bd2a662e34a6395117027b5c28c5b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c56bd2a662e34a6395117027b5c28c5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c56bd2a662e34a6395117027b5c28c5b", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] Aug 11 11:12:15.493283 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant: tempest-AttachVolumeNegativeTest-848160622 Aug 11 11:12:15.493283 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant-Id: c56bd2a662e34a6395117027b5c28c5b Aug 11 11:12:15.493283 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-848160622 Aug 11 11:12:15.493283 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User: tempest-AttachVolumeNegativeTest-848160622-project Aug 11 11:12:15.493283 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Domain-Id: default Aug 11 11:12:15.493283 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Domain-Name: Default Aug 11 11:12:15.493283 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Id: 08d81bcd5a4f43ce8b4839ee15cb163b Aug 11 11:12:15.493283 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Name: tempest-AttachVolumeNegativeTest-848160622-project Aug 11 11:12:15.493283 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: method: > Aug 11 11:12:15.493283 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: exception: Instance f6bf35b3-de6a-41ae-81b7-8f45852ab5e2 could not be found. Aug 11 11:12:15.493283 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: action_args: {'id': 'f6bf35b3-de6a-41ae-81b7-8f45852ab5e2'} Aug 11 11:12:15.494232 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 11:12:15.494232 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:12:15.494232 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 11:12:15.494232 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 11:12:15.494232 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 11:12:15.494232 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 11:12:15.494232 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 11:12:15.494232 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 11:12:15.494232 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 11:12:15.494232 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 11:12:15.494232 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6bf35b3-de6a-41ae-81b7-8f45852ab5e2 could not be found. Aug 11 11:12:15.494232 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:12:15.494232 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:12:15.494232 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:12:15.494232 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:12:15.494232 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:12:15.494232 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:12:15.494232 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 11:12:15.494232 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 11:12:15.494232 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 11:12:15.496018 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 11:12:15.496018 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 11:12:15.496018 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 11:12:15.496018 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 11:12:15.496018 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 11:12:15.496018 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 11:12:15.496018 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 11:12:15.496018 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6bf35b3-de6a-41ae-81b7-8f45852ab5e2 could not be found. Aug 11 11:12:15.496018 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:12:15.496018 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:12:15.496018 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:12:15.496018 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:12:15.496018 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:12:15.496018 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:12:15.496018 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 11:12:15.496018 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 11:12:15.496018 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6bf35b3-de6a-41ae-81b7-8f45852ab5e2 could not be found. Aug 11 11:12:15.496018 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:12:15.499342 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-595610a4-7a5a-41a9-824b-d635efc07c24 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Returning 404 to user: Instance f6bf35b3-de6a-41ae-81b7-8f45852ab5e2 could not be found. {{(pid=121231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 11:12:15.499342 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-595610a4-7a5a-41a9-824b-d635efc07c24 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/f6bf35b3-de6a-41ae-81b7-8f45852ab5e2" status: 404 len: 111 microversion: 2.1 time: 0.034468 Aug 11 11:12:15.499342 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 496/1006] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:12:15 2022] GET /compute/v2.1/servers/f6bf35b3-de6a-41ae-81b7-8f45852ab5e2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 11:12:15.501615 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-b332a636-8ae5-41e9-b93c-5b1564c8a588 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '.version_select at 0x7faab0d51940>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:12:15.624286 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-b332a636-8ae5-41e9-b93c-5b1564c8a588 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1026892144" status: 202 len: 0 microversion: 2.1 time: 0.126436 Aug 11 11:12:15.625555 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 511/1007] 10.222.0.48 () {58 vars in 1221 bytes} [Thu Aug 11 11:12:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1026892144 => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 11:12:15.775679 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-df7711ae-815b-49dd-8073-c1e48f0817a7 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:12:15.776255 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-df7711ae-815b-49dd-8073-c1e48f0817a7 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: 6775b84f-c318-4b37-9fdf-e93e607dfa4e] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:12:15.782159 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-df7711ae-815b-49dd-8073-c1e48f0817a7 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:15.782636 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-df7711ae-815b-49dd-8073-c1e48f0817a7 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:15.783065 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-df7711ae-815b-49dd-8073-c1e48f0817a7 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:15.786024 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-df7711ae-815b-49dd-8073-c1e48f0817a7 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:15.786024 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-df7711ae-815b-49dd-8073-c1e48f0817a7 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:15.786024 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-df7711ae-815b-49dd-8073-c1e48f0817a7 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:15.916749 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-df7711ae-815b-49dd-8073-c1e48f0817a7 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9dbe3b7fdd482681b6ab94c26f4e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d394882f294c6283721bcc6f8ff04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:12:15.924824 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-df7711ae-815b-49dd-8073-c1e48f0817a7 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "GET /compute/v2.1/servers/6775b84f-c318-4b37-9fdf-e93e607dfa4e" status: 200 len: 1265 microversion: 2.1 time: 0.153336 Aug 11 11:12:15.925375 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 497/1008] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:12:15 2022] GET /compute/v2.1/servers/6775b84f-c318-4b37-9fdf-e93e607dfa4e => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:12:16.524668 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-2ef72d60-49b0-497e-bb64-234d48574f72 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Action: 'create', calling method: .version_select at 0x7faab0b76940>, body: {"keypair": {"name": "tempest-keypair-166222037", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIUwEE6s3KD+bnrxPAUdXVw5QAU+wmXM9IcxcKJa23J72eV49uCnroFar76oo0JUXi63sP3A7qsV2pc6pNTVV5v9aqUHElF2KTgdum4Z/YaKfvHdgagwqSUr64BxcgZCJg=="}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:12:16.541360 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-2ef72d60-49b0-497e-bb64-234d48574f72 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Getting quotas for project c56bd2a662e34a6395117027b5c28c5b. Resources: {'key_pairs'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 11:12:16.545199 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-2ef72d60-49b0-497e-bb64-234d48574f72 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Getting quotas for user 08d81bcd5a4f43ce8b4839ee15cb163b and project c56bd2a662e34a6395117027b5c28c5b. Resources: {'key_pairs'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 11:12:16.659451 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-2ef72d60-49b0-497e-bb64-234d48574f72 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.138685 Aug 11 11:12:16.666631 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 512/1009] 10.222.0.48 () {60 vars in 1159 bytes} [Thu Aug 11 11:12:16 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:12:16.944758 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-e626203a-e871-48ca-9062-81476e080c50 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:12:16.945951 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-e626203a-e871-48ca-9062-81476e080c50 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: 6775b84f-c318-4b37-9fdf-e93e607dfa4e] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:12:16.952829 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e626203a-e871-48ca-9062-81476e080c50 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:16.953313 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e626203a-e871-48ca-9062-81476e080c50 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:16.953749 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e626203a-e871-48ca-9062-81476e080c50 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:16.954496 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e626203a-e871-48ca-9062-81476e080c50 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:16.954951 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e626203a-e871-48ca-9062-81476e080c50 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:16.955372 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e626203a-e871-48ca-9062-81476e080c50 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:17.094615 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-e626203a-e871-48ca-9062-81476e080c50 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9dbe3b7fdd482681b6ab94c26f4e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d394882f294c6283721bcc6f8ff04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:12:17.100175 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell0:SELECT=2 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:12:17.102720 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-e626203a-e871-48ca-9062-81476e080c50 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "GET /compute/v2.1/servers/6775b84f-c318-4b37-9fdf-e93e607dfa4e" status: 200 len: 1265 microversion: 2.1 time: 0.161867 Aug 11 11:12:17.103286 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 498/1010] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:12:16 2022] GET /compute/v2.1/servers/6775b84f-c318-4b37-9fdf-e93e607dfa4e => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:12:18.123360 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-0519cf91-77e1-4954-8a94-934cb8d27ed4 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:12:18.124755 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-0519cf91-77e1-4954-8a94-934cb8d27ed4 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: 6775b84f-c318-4b37-9fdf-e93e607dfa4e] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:12:18.131998 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0519cf91-77e1-4954-8a94-934cb8d27ed4 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:18.132511 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0519cf91-77e1-4954-8a94-934cb8d27ed4 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:18.132988 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0519cf91-77e1-4954-8a94-934cb8d27ed4 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:18.133737 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0519cf91-77e1-4954-8a94-934cb8d27ed4 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:18.134242 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0519cf91-77e1-4954-8a94-934cb8d27ed4 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:18.134665 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0519cf91-77e1-4954-8a94-934cb8d27ed4 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:18.272717 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-0519cf91-77e1-4954-8a94-934cb8d27ed4 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9dbe3b7fdd482681b6ab94c26f4e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d394882f294c6283721bcc6f8ff04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:12:18.280427 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-0519cf91-77e1-4954-8a94-934cb8d27ed4 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "GET /compute/v2.1/servers/6775b84f-c318-4b37-9fdf-e93e607dfa4e" status: 200 len: 1265 microversion: 2.1 time: 0.161674 Aug 11 11:12:18.281598 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 513/1011] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:12:18 2022] GET /compute/v2.1/servers/6775b84f-c318-4b37-9fdf-e93e607dfa4e => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:12:19.026786 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-834f1aae-cd03-46f1-8420-c7e65b06eb65 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-530679674", "imageRef": "05993162-aafd-4f1d-b781-ec09593713e5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e9237d16-c254-4c91-b4d6-ffa10fd31ebe"}], "security_groups": [{"name": "tempest-securitygroup--364620867"}], "key_name": "tempest-keypair-166222037", "user_data": "}} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:12:19.035351 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell0:SELECT=8 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:12:19.132088 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.network.neutron [None req-834f1aae-cd03-46f1-8420-c7e65b06eb65 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] validate_networks() for [('e9237d16-c254-4c91-b4d6-ffa10fd31ebe', None, None, None, None, None)] {{(pid=121231) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 11 11:12:19.301421 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-0eaeef72-5355-4d93-b77d-34cc54e604fa tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:12:19.302037 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-0eaeef72-5355-4d93-b77d-34cc54e604fa tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: 6775b84f-c318-4b37-9fdf-e93e607dfa4e] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:12:19.308534 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0eaeef72-5355-4d93-b77d-34cc54e604fa tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:19.309027 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0eaeef72-5355-4d93-b77d-34cc54e604fa tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:19.309466 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0eaeef72-5355-4d93-b77d-34cc54e604fa tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:19.310167 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0eaeef72-5355-4d93-b77d-34cc54e604fa tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:19.310624 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0eaeef72-5355-4d93-b77d-34cc54e604fa tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:19.311234 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0eaeef72-5355-4d93-b77d-34cc54e604fa tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:19.531933 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-0eaeef72-5355-4d93-b77d-34cc54e604fa tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9dbe3b7fdd482681b6ab94c26f4e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d394882f294c6283721bcc6f8ff04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:12:19.539894 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-0eaeef72-5355-4d93-b77d-34cc54e604fa tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "GET /compute/v2.1/servers/6775b84f-c318-4b37-9fdf-e93e607dfa4e" status: 200 len: 1265 microversion: 2.1 time: 0.242385 Aug 11 11:12:19.540465 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 514/1012] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:12:19 2022] GET /compute/v2.1/servers/6775b84f-c318-4b37-9fdf-e93e607dfa4e => generated 1265 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:12:19.573712 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-834f1aae-cd03-46f1-8420-c7e65b06eb65 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Flavor limits 0:0:0 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 11 11:12:19.574141 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-834f1aae-cd03-46f1-8420-c7e65b06eb65 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Image limits 0:0:0 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 11 11:12:19.574707 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-834f1aae-cd03-46f1-8420-c7e65b06eb65 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Flavor pref 0:0:0 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 11 11:12:19.575330 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-834f1aae-cd03-46f1-8420-c7e65b06eb65 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Image pref 0:0:0 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 11 11:12:19.575804 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-834f1aae-cd03-46f1-8420-c7e65b06eb65 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 11 11:12:19.585278 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-834f1aae-cd03-46f1-8420-c7e65b06eb65 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:19.585767 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-834f1aae-cd03-46f1-8420-c7e65b06eb65 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:19.586203 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-834f1aae-cd03-46f1-8420-c7e65b06eb65 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:19.586986 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-834f1aae-cd03-46f1-8420-c7e65b06eb65 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:19.587443 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-834f1aae-cd03-46f1-8420-c7e65b06eb65 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:19.587899 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-834f1aae-cd03-46f1-8420-c7e65b06eb65 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:19.604875 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.quota [None req-834f1aae-cd03-46f1-8420-c7e65b06eb65 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Getting quotas for project c56bd2a662e34a6395117027b5c28c5b. Resources: {'ram', 'cores', 'instances'} {{(pid=121231) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 11:12:19.608969 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.quota [None req-834f1aae-cd03-46f1-8420-c7e65b06eb65 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Getting quotas for user 08d81bcd5a4f43ce8b4839ee15cb163b and project c56bd2a662e34a6395117027b5c28c5b. Resources: {'ram', 'cores', 'instances'} {{(pid=121231) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 11:12:19.620880 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-834f1aae-cd03-46f1-8420-c7e65b06eb65 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Going to run 1 instances... {{(pid=121231) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 11 11:12:19.623226 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-834f1aae-cd03-46f1-8420-c7e65b06eb65 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: 5a7a6694-e9a6-4914-a702-51fcc95a5233] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='05993162-aafd-4f1d-b781-ec09593713e5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121231) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 11 11:12:19.784373 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-834f1aae-cd03-46f1-8420-c7e65b06eb65 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.761828 Aug 11 11:12:19.785310 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 499/1013] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Aug 11 11:12:19 2022] POST /compute/v2.1/servers => generated 401 bytes in 764 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 11 11:12:19.796036 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-2125683c-6538-456b-84b4-9693c2570f6b tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:12:19.796640 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-2125683c-6538-456b-84b4-9693c2570f6b tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: 5a7a6694-e9a6-4914-a702-51fcc95a5233] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:12:19.855030 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-2125683c-6538-456b-84b4-9693c2570f6b tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08d81bcd5a4f43ce8b4839ee15cb163b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56bd2a662e34a6395117027b5c28c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:12:19.861997 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-2125683c-6538-456b-84b4-9693c2570f6b tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7a6694-e9a6-4914-a702-51fcc95a5233" status: 200 len: 1240 microversion: 2.1 time: 0.069703 Aug 11 11:12:19.862536 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 515/1014] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:12:19 2022] GET /compute/v2.1/servers/5a7a6694-e9a6-4914-a702-51fcc95a5233 => generated 1240 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:12:20.561824 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-9945760e-f5c1-40a4-b1f8-9463d5881c20 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:12:20.562779 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-9945760e-f5c1-40a4-b1f8-9463d5881c20 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: 6775b84f-c318-4b37-9fdf-e93e607dfa4e] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:12:20.569538 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9945760e-f5c1-40a4-b1f8-9463d5881c20 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:20.570113 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9945760e-f5c1-40a4-b1f8-9463d5881c20 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:20.570523 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9945760e-f5c1-40a4-b1f8-9463d5881c20 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:20.571291 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9945760e-f5c1-40a4-b1f8-9463d5881c20 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:20.571753 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9945760e-f5c1-40a4-b1f8-9463d5881c20 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:20.572271 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9945760e-f5c1-40a4-b1f8-9463d5881c20 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:20.749940 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-9945760e-f5c1-40a4-b1f8-9463d5881c20 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9dbe3b7fdd482681b6ab94c26f4e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d394882f294c6283721bcc6f8ff04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:12:20.759084 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-9945760e-f5c1-40a4-b1f8-9463d5881c20 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "GET /compute/v2.1/servers/6775b84f-c318-4b37-9fdf-e93e607dfa4e" status: 200 len: 1265 microversion: 2.1 time: 0.201552 Aug 11 11:12:20.759752 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 500/1015] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:12:20 2022] GET /compute/v2.1/servers/6775b84f-c318-4b37-9fdf-e93e607dfa4e => generated 1265 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:12:20.883383 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-057cfb30-a483-49e7-b1e7-4730413935fa tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:12:20.884022 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-057cfb30-a483-49e7-b1e7-4730413935fa tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: 5a7a6694-e9a6-4914-a702-51fcc95a5233] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:12:20.892399 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-057cfb30-a483-49e7-b1e7-4730413935fa tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:20.892888 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-057cfb30-a483-49e7-b1e7-4730413935fa tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:20.893320 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-057cfb30-a483-49e7-b1e7-4730413935fa tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:20.894016 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-057cfb30-a483-49e7-b1e7-4730413935fa tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:20.896312 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-057cfb30-a483-49e7-b1e7-4730413935fa tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:20.898003 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-057cfb30-a483-49e7-b1e7-4730413935fa tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:20.994331 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-057cfb30-a483-49e7-b1e7-4730413935fa tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08d81bcd5a4f43ce8b4839ee15cb163b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56bd2a662e34a6395117027b5c28c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:12:21.002248 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-057cfb30-a483-49e7-b1e7-4730413935fa tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7a6694-e9a6-4914-a702-51fcc95a5233" status: 200 len: 1244 microversion: 2.1 time: 0.123587 Aug 11 11:12:21.003400 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 516/1016] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:12:20 2022] GET /compute/v2.1/servers/5a7a6694-e9a6-4914-a702-51fcc95a5233 => generated 1244 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:12:21.783298 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-b5a99eeb-1a0c-40bf-9b76-4f7d44886354 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:12:21.784024 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-b5a99eeb-1a0c-40bf-9b76-4f7d44886354 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: 6775b84f-c318-4b37-9fdf-e93e607dfa4e] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:12:21.791652 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b5a99eeb-1a0c-40bf-9b76-4f7d44886354 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:21.792576 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b5a99eeb-1a0c-40bf-9b76-4f7d44886354 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:21.792576 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b5a99eeb-1a0c-40bf-9b76-4f7d44886354 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:21.793247 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b5a99eeb-1a0c-40bf-9b76-4f7d44886354 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:21.793732 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b5a99eeb-1a0c-40bf-9b76-4f7d44886354 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:21.794161 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b5a99eeb-1a0c-40bf-9b76-4f7d44886354 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:21.931381 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-b5a99eeb-1a0c-40bf-9b76-4f7d44886354 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9dbe3b7fdd482681b6ab94c26f4e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d394882f294c6283721bcc6f8ff04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:12:21.940565 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-b5a99eeb-1a0c-40bf-9b76-4f7d44886354 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "GET /compute/v2.1/servers/6775b84f-c318-4b37-9fdf-e93e607dfa4e" status: 200 len: 1265 microversion: 2.1 time: 0.164150 Aug 11 11:12:21.951811 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 501/1017] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:12:21 2022] GET /compute/v2.1/servers/6775b84f-c318-4b37-9fdf-e93e607dfa4e => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:12:22.023184 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-0e712a36-7063-4171-a6a8-ede17b083d9d tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:12:22.023999 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-0e712a36-7063-4171-a6a8-ede17b083d9d tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: 5a7a6694-e9a6-4914-a702-51fcc95a5233] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:12:22.030606 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0e712a36-7063-4171-a6a8-ede17b083d9d tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:22.031096 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0e712a36-7063-4171-a6a8-ede17b083d9d tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:22.031551 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0e712a36-7063-4171-a6a8-ede17b083d9d tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:22.032280 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0e712a36-7063-4171-a6a8-ede17b083d9d tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:22.032735 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0e712a36-7063-4171-a6a8-ede17b083d9d tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:22.033164 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0e712a36-7063-4171-a6a8-ede17b083d9d tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:22.096138 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-0e712a36-7063-4171-a6a8-ede17b083d9d tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08d81bcd5a4f43ce8b4839ee15cb163b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56bd2a662e34a6395117027b5c28c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:12:22.104176 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-0e712a36-7063-4171-a6a8-ede17b083d9d tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7a6694-e9a6-4914-a702-51fcc95a5233" status: 200 len: 1292 microversion: 2.1 time: 0.085615 Aug 11 11:12:22.104749 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 517/1018] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:12:22 2022] GET /compute/v2.1/servers/5a7a6694-e9a6-4914-a702-51fcc95a5233 => generated 1292 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:12:22.965177 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-c8a2b49b-34c6-4caf-b124-e992488a4b17 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:12:22.967238 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-c8a2b49b-34c6-4caf-b124-e992488a4b17 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: 6775b84f-c318-4b37-9fdf-e93e607dfa4e] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:12:22.990911 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c8a2b49b-34c6-4caf-b124-e992488a4b17 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:22.992370 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c8a2b49b-34c6-4caf-b124-e992488a4b17 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:22.992818 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c8a2b49b-34c6-4caf-b124-e992488a4b17 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:22.993530 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c8a2b49b-34c6-4caf-b124-e992488a4b17 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:22.993985 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c8a2b49b-34c6-4caf-b124-e992488a4b17 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:22.994406 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c8a2b49b-34c6-4caf-b124-e992488a4b17 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:23.125669 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-89652af2-b33f-495d-a98c-b057a6e1956e tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:12:23.126377 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-89652af2-b33f-495d-a98c-b057a6e1956e tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: 5a7a6694-e9a6-4914-a702-51fcc95a5233] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:12:23.135067 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-89652af2-b33f-495d-a98c-b057a6e1956e tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:23.137139 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-89652af2-b33f-495d-a98c-b057a6e1956e tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:23.137599 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-89652af2-b33f-495d-a98c-b057a6e1956e tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:23.138376 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-89652af2-b33f-495d-a98c-b057a6e1956e tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:23.140002 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-89652af2-b33f-495d-a98c-b057a6e1956e tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:23.140541 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-89652af2-b33f-495d-a98c-b057a6e1956e tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:23.271957 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-89652af2-b33f-495d-a98c-b057a6e1956e tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08d81bcd5a4f43ce8b4839ee15cb163b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56bd2a662e34a6395117027b5c28c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:12:23.285654 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-89652af2-b33f-495d-a98c-b057a6e1956e tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7a6694-e9a6-4914-a702-51fcc95a5233" status: 200 len: 1298 microversion: 2.1 time: 0.164397 Aug 11 11:12:23.286349 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 518/1019] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:12:23 2022] GET /compute/v2.1/servers/5a7a6694-e9a6-4914-a702-51fcc95a5233 => generated 1298 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:12:23.304323 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-c8a2b49b-34c6-4caf-b124-e992488a4b17 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9dbe3b7fdd482681b6ab94c26f4e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d394882f294c6283721bcc6f8ff04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:12:23.311781 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-c8a2b49b-34c6-4caf-b124-e992488a4b17 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "GET /compute/v2.1/servers/6775b84f-c318-4b37-9fdf-e93e607dfa4e" status: 200 len: 1265 microversion: 2.1 time: 0.352958 Aug 11 11:12:23.312350 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 502/1020] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:12:22 2022] GET /compute/v2.1/servers/6775b84f-c318-4b37-9fdf-e93e607dfa4e => generated 1265 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:12:24.310041 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-9a5860fc-e226-44e2-962d-0cdb270485b2 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:12:24.310792 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-9a5860fc-e226-44e2-962d-0cdb270485b2 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: 5a7a6694-e9a6-4914-a702-51fcc95a5233] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:12:24.316926 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9a5860fc-e226-44e2-962d-0cdb270485b2 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:24.317419 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9a5860fc-e226-44e2-962d-0cdb270485b2 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:24.317859 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9a5860fc-e226-44e2-962d-0cdb270485b2 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:24.318568 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9a5860fc-e226-44e2-962d-0cdb270485b2 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:24.319585 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9a5860fc-e226-44e2-962d-0cdb270485b2 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:24.320046 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9a5860fc-e226-44e2-962d-0cdb270485b2 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:24.332440 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-0f7dfb5e-d22c-4a70-a43c-d0af6d4ffe9d tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:12:24.333632 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-0f7dfb5e-d22c-4a70-a43c-d0af6d4ffe9d tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: 6775b84f-c318-4b37-9fdf-e93e607dfa4e] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:12:24.340145 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0f7dfb5e-d22c-4a70-a43c-d0af6d4ffe9d tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:24.340645 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0f7dfb5e-d22c-4a70-a43c-d0af6d4ffe9d tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:24.344928 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0f7dfb5e-d22c-4a70-a43c-d0af6d4ffe9d tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:24.344928 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0f7dfb5e-d22c-4a70-a43c-d0af6d4ffe9d tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:24.344928 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0f7dfb5e-d22c-4a70-a43c-d0af6d4ffe9d tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:24.344928 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0f7dfb5e-d22c-4a70-a43c-d0af6d4ffe9d tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:24.595594 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-9a5860fc-e226-44e2-962d-0cdb270485b2 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08d81bcd5a4f43ce8b4839ee15cb163b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56bd2a662e34a6395117027b5c28c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:12:24.611141 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-9a5860fc-e226-44e2-962d-0cdb270485b2 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7a6694-e9a6-4914-a702-51fcc95a5233" status: 200 len: 1365 microversion: 2.1 time: 0.306466 Aug 11 11:12:24.612099 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 519/1021] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:12:24 2022] GET /compute/v2.1/servers/5a7a6694-e9a6-4914-a702-51fcc95a5233 => generated 1365 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:12:24.630879 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-0f7dfb5e-d22c-4a70-a43c-d0af6d4ffe9d tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9dbe3b7fdd482681b6ab94c26f4e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d394882f294c6283721bcc6f8ff04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:12:24.640574 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-0f7dfb5e-d22c-4a70-a43c-d0af6d4ffe9d tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "GET /compute/v2.1/servers/6775b84f-c318-4b37-9fdf-e93e607dfa4e" status: 200 len: 1265 microversion: 2.1 time: 0.311934 Aug 11 11:12:24.641321 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 503/1022] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:12:24 2022] GET /compute/v2.1/servers/6775b84f-c318-4b37-9fdf-e93e607dfa4e => generated 1265 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:12:24.804870 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-00a17f86-626c-4efd-9a6b-405651ea1f03 req-022086ea-ff28-4b7e-aa1d-429398468e69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a7a6694-e9a6-4914-a702-51fcc95a5233", "tag": "adba626d-2eea-4612-bdc0-e917909acfe1"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:12:24.815579 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-00a17f86-626c-4efd-9a6b-405651ea1f03 req-022086ea-ff28-4b7e-aa1d-429398468e69 service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:24.816206 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-00a17f86-626c-4efd-9a6b-405651ea1f03 req-022086ea-ff28-4b7e-aa1d-429398468e69 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:24.816734 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-00a17f86-626c-4efd-9a6b-405651ea1f03 req-022086ea-ff28-4b7e-aa1d-429398468e69 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:24.832202 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-00a17f86-626c-4efd-9a6b-405651ea1f03 req-022086ea-ff28-4b7e-aa1d-429398468e69 service nova] Creating event network-changed:adba626d-2eea-4612-bdc0-e917909acfe1 for instance 5a7a6694-e9a6-4914-a702-51fcc95a5233 on hv-cinder-82002 Aug 11 11:12:24.837921 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-00a17f86-626c-4efd-9a6b-405651ea1f03 req-022086ea-ff28-4b7e-aa1d-429398468e69 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040528 Aug 11 11:12:24.838632 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 520/1023] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:12:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:12:25.048523 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-e50c0697-ebda-420c-b052-af1d0ac89cbb req-4bdae13c-a231-4edf-8d44-3344d04d299c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6775b84f-c318-4b37-9fdf-e93e607dfa4e", "name": "network-vif-plugged", "status": "completed", "tag": "05193d12-2729-4079-9c68-2950747232ad"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:12:25.066404 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-e50c0697-ebda-420c-b052-af1d0ac89cbb req-4bdae13c-a231-4edf-8d44-3344d04d299c service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:25.066404 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-e50c0697-ebda-420c-b052-af1d0ac89cbb req-4bdae13c-a231-4edf-8d44-3344d04d299c service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:25.066404 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-e50c0697-ebda-420c-b052-af1d0ac89cbb req-4bdae13c-a231-4edf-8d44-3344d04d299c service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:25.074045 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-e50c0697-ebda-420c-b052-af1d0ac89cbb req-4bdae13c-a231-4edf-8d44-3344d04d299c service nova] Creating event network-vif-plugged:05193d12-2729-4079-9c68-2950747232ad for instance 6775b84f-c318-4b37-9fdf-e93e607dfa4e on hv-cinder-82002 Aug 11 11:12:25.079276 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-e50c0697-ebda-420c-b052-af1d0ac89cbb req-4bdae13c-a231-4edf-8d44-3344d04d299c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034441 Aug 11 11:12:25.079911 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 504/1024] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:12:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 11:12:25.634975 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-ec879f37-eec6-4fca-869e-d4ebd2b6b483 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:12:25.635692 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-ec879f37-eec6-4fca-869e-d4ebd2b6b483 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: 5a7a6694-e9a6-4914-a702-51fcc95a5233] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:12:25.638749 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:12:25.642299 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ec879f37-eec6-4fca-869e-d4ebd2b6b483 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:25.642780 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ec879f37-eec6-4fca-869e-d4ebd2b6b483 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:25.643217 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ec879f37-eec6-4fca-869e-d4ebd2b6b483 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:25.643996 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ec879f37-eec6-4fca-869e-d4ebd2b6b483 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:25.644458 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ec879f37-eec6-4fca-869e-d4ebd2b6b483 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:25.644883 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ec879f37-eec6-4fca-869e-d4ebd2b6b483 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:25.663352 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-2020ec4f-b17e-4ec4-b876-9951789c9815 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:12:25.664179 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-2020ec4f-b17e-4ec4-b876-9951789c9815 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: 6775b84f-c318-4b37-9fdf-e93e607dfa4e] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:12:25.670653 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2020ec4f-b17e-4ec4-b876-9951789c9815 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:25.671381 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2020ec4f-b17e-4ec4-b876-9951789c9815 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:25.672050 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2020ec4f-b17e-4ec4-b876-9951789c9815 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:25.673122 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2020ec4f-b17e-4ec4-b876-9951789c9815 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:25.673736 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2020ec4f-b17e-4ec4-b876-9951789c9815 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:25.674306 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2020ec4f-b17e-4ec4-b876-9951789c9815 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:25.912994 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-ec879f37-eec6-4fca-869e-d4ebd2b6b483 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08d81bcd5a4f43ce8b4839ee15cb163b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56bd2a662e34a6395117027b5c28c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:12:25.921259 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-2020ec4f-b17e-4ec4-b876-9951789c9815 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9dbe3b7fdd482681b6ab94c26f4e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d394882f294c6283721bcc6f8ff04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:12:25.921510 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-ec879f37-eec6-4fca-869e-d4ebd2b6b483 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7a6694-e9a6-4914-a702-51fcc95a5233" status: 200 len: 1365 microversion: 2.1 time: 0.290953 Aug 11 11:12:25.922079 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 521/1025] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:12:25 2022] GET /compute/v2.1/servers/5a7a6694-e9a6-4914-a702-51fcc95a5233 => generated 1365 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:12:25.932863 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-2020ec4f-b17e-4ec4-b876-9951789c9815 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "GET /compute/v2.1/servers/6775b84f-c318-4b37-9fdf-e93e607dfa4e" status: 200 len: 1265 microversion: 2.1 time: 0.275301 Aug 11 11:12:25.933715 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 505/1026] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:12:25 2022] GET /compute/v2.1/servers/6775b84f-c318-4b37-9fdf-e93e607dfa4e => generated 1265 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:12:26.942674 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-5cc1b07a-b4d9-4518-9d5a-7865f53f3e77 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:12:26.943326 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-5cc1b07a-b4d9-4518-9d5a-7865f53f3e77 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: 5a7a6694-e9a6-4914-a702-51fcc95a5233] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:12:26.950173 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5cc1b07a-b4d9-4518-9d5a-7865f53f3e77 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:26.950657 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5cc1b07a-b4d9-4518-9d5a-7865f53f3e77 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:26.951097 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5cc1b07a-b4d9-4518-9d5a-7865f53f3e77 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:26.951810 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5cc1b07a-b4d9-4518-9d5a-7865f53f3e77 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:26.952271 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5cc1b07a-b4d9-4518-9d5a-7865f53f3e77 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:26.952697 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5cc1b07a-b4d9-4518-9d5a-7865f53f3e77 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:26.954354 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-5ac7fa5d-5f45-4c63-a05b-0bb23590b3c4 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:12:26.955068 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-5ac7fa5d-5f45-4c63-a05b-0bb23590b3c4 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: 6775b84f-c318-4b37-9fdf-e93e607dfa4e] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:12:26.958517 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:12:26.962087 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5ac7fa5d-5f45-4c63-a05b-0bb23590b3c4 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:26.962566 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5ac7fa5d-5f45-4c63-a05b-0bb23590b3c4 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:26.962994 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5ac7fa5d-5f45-4c63-a05b-0bb23590b3c4 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:26.963742 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5ac7fa5d-5f45-4c63-a05b-0bb23590b3c4 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:26.964221 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5ac7fa5d-5f45-4c63-a05b-0bb23590b3c4 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:26.964639 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5ac7fa5d-5f45-4c63-a05b-0bb23590b3c4 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:27.148859 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-5cc1b07a-b4d9-4518-9d5a-7865f53f3e77 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08d81bcd5a4f43ce8b4839ee15cb163b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56bd2a662e34a6395117027b5c28c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:12:27.153434 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-5ac7fa5d-5f45-4c63-a05b-0bb23590b3c4 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9dbe3b7fdd482681b6ab94c26f4e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d394882f294c6283721bcc6f8ff04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:12:27.156516 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-5cc1b07a-b4d9-4518-9d5a-7865f53f3e77 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7a6694-e9a6-4914-a702-51fcc95a5233" status: 200 len: 1365 microversion: 2.1 time: 0.218160 Aug 11 11:12:27.157355 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 522/1027] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:12:26 2022] GET /compute/v2.1/servers/5a7a6694-e9a6-4914-a702-51fcc95a5233 => generated 1365 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:12:27.161608 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-5ac7fa5d-5f45-4c63-a05b-0bb23590b3c4 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "GET /compute/v2.1/servers/6775b84f-c318-4b37-9fdf-e93e607dfa4e" status: 200 len: 1265 microversion: 2.1 time: 0.211024 Aug 11 11:12:27.162902 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 506/1028] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:12:26 2022] GET /compute/v2.1/servers/6775b84f-c318-4b37-9fdf-e93e607dfa4e => generated 1265 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:12:28.178454 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-05b8c141-d635-4ae2-82bb-3af5a12dfbdf tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:12:28.179069 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-05b8c141-d635-4ae2-82bb-3af5a12dfbdf tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: 5a7a6694-e9a6-4914-a702-51fcc95a5233] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:12:28.183630 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-33e86ba0-655c-46c6-a089-2f5d75856249 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:12:28.184538 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-33e86ba0-655c-46c6-a089-2f5d75856249 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: 6775b84f-c318-4b37-9fdf-e93e607dfa4e] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:12:28.185949 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-05b8c141-d635-4ae2-82bb-3af5a12dfbdf tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:28.186438 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-05b8c141-d635-4ae2-82bb-3af5a12dfbdf tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:28.186895 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-05b8c141-d635-4ae2-82bb-3af5a12dfbdf tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:28.187904 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-05b8c141-d635-4ae2-82bb-3af5a12dfbdf tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:28.188541 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-05b8c141-d635-4ae2-82bb-3af5a12dfbdf tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:28.193927 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-05b8c141-d635-4ae2-82bb-3af5a12dfbdf tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:28.194250 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-33e86ba0-655c-46c6-a089-2f5d75856249 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:28.194250 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-33e86ba0-655c-46c6-a089-2f5d75856249 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:28.195558 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-33e86ba0-655c-46c6-a089-2f5d75856249 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:28.196389 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-33e86ba0-655c-46c6-a089-2f5d75856249 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:28.196928 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-33e86ba0-655c-46c6-a089-2f5d75856249 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:28.197441 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-33e86ba0-655c-46c6-a089-2f5d75856249 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:28.390967 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-05b8c141-d635-4ae2-82bb-3af5a12dfbdf tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08d81bcd5a4f43ce8b4839ee15cb163b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56bd2a662e34a6395117027b5c28c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:12:28.399661 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-33e86ba0-655c-46c6-a089-2f5d75856249 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9dbe3b7fdd482681b6ab94c26f4e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d394882f294c6283721bcc6f8ff04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:12:28.405848 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-05b8c141-d635-4ae2-82bb-3af5a12dfbdf tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7a6694-e9a6-4914-a702-51fcc95a5233" status: 200 len: 1365 microversion: 2.1 time: 0.229766 Aug 11 11:12:28.405848 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 523/1029] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:12:28 2022] GET /compute/v2.1/servers/5a7a6694-e9a6-4914-a702-51fcc95a5233 => generated 1365 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:12:28.409884 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-33e86ba0-655c-46c6-a089-2f5d75856249 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "GET /compute/v2.1/servers/6775b84f-c318-4b37-9fdf-e93e607dfa4e" status: 200 len: 1265 microversion: 2.1 time: 0.230567 Aug 11 11:12:28.410457 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 507/1030] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:12:28 2022] GET /compute/v2.1/servers/6775b84f-c318-4b37-9fdf-e93e607dfa4e => generated 1265 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:12:29.426341 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-14f58f01-d885-4df7-bbf1-7158633d750d tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:12:29.433002 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-46b7fabd-75b0-452b-a586-3fb9283fc2c1 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:12:29.433614 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-46b7fabd-75b0-452b-a586-3fb9283fc2c1 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: 6775b84f-c318-4b37-9fdf-e93e607dfa4e] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:12:29.436493 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-14f58f01-d885-4df7-bbf1-7158633d750d tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: 5a7a6694-e9a6-4914-a702-51fcc95a5233] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:12:29.442825 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-14f58f01-d885-4df7-bbf1-7158633d750d tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:29.443688 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-14f58f01-d885-4df7-bbf1-7158633d750d tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:29.444348 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-14f58f01-d885-4df7-bbf1-7158633d750d tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:29.445285 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-14f58f01-d885-4df7-bbf1-7158633d750d tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:29.445943 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-14f58f01-d885-4df7-bbf1-7158633d750d tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:29.446701 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-14f58f01-d885-4df7-bbf1-7158633d750d tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:29.446883 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-46b7fabd-75b0-452b-a586-3fb9283fc2c1 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:29.447557 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-46b7fabd-75b0-452b-a586-3fb9283fc2c1 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:29.448378 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-46b7fabd-75b0-452b-a586-3fb9283fc2c1 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:29.449241 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-46b7fabd-75b0-452b-a586-3fb9283fc2c1 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:29.449861 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-46b7fabd-75b0-452b-a586-3fb9283fc2c1 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:29.450444 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-46b7fabd-75b0-452b-a586-3fb9283fc2c1 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:29.595714 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell0:SELECT=2 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:12:29.615353 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell0:SELECT=6 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:12:29.651177 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-14f58f01-d885-4df7-bbf1-7158633d750d tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08d81bcd5a4f43ce8b4839ee15cb163b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56bd2a662e34a6395117027b5c28c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:12:29.655371 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-46b7fabd-75b0-452b-a586-3fb9283fc2c1 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9dbe3b7fdd482681b6ab94c26f4e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d394882f294c6283721bcc6f8ff04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:12:29.658049 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:12:29.661068 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-14f58f01-d885-4df7-bbf1-7158633d750d tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7a6694-e9a6-4914-a702-51fcc95a5233" status: 200 len: 1365 microversion: 2.1 time: 0.239347 Aug 11 11:12:29.661642 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 524/1031] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:12:29 2022] GET /compute/v2.1/servers/5a7a6694-e9a6-4914-a702-51fcc95a5233 => generated 1365 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:12:29.668151 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-46b7fabd-75b0-452b-a586-3fb9283fc2c1 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "GET /compute/v2.1/servers/6775b84f-c318-4b37-9fdf-e93e607dfa4e" status: 200 len: 1265 microversion: 2.1 time: 0.239016 Aug 11 11:12:29.680374 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 508/1032] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:12:29 2022] GET /compute/v2.1/servers/6775b84f-c318-4b37-9fdf-e93e607dfa4e => generated 1265 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:12:30.686906 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-ba6fd600-e457-48f7-832a-2b59018f4f72 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:12:30.687735 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-ba6fd600-e457-48f7-832a-2b59018f4f72 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: 5a7a6694-e9a6-4914-a702-51fcc95a5233] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:12:30.690129 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-69b5a77a-3f31-4cbf-a4a9-5c2ec3f3421c tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:12:30.690544 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell0:SELECT=6 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:12:30.690735 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-69b5a77a-3f31-4cbf-a4a9-5c2ec3f3421c tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: 6775b84f-c318-4b37-9fdf-e93e607dfa4e] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:12:30.697276 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ba6fd600-e457-48f7-832a-2b59018f4f72 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:30.698025 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ba6fd600-e457-48f7-832a-2b59018f4f72 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:30.698197 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-69b5a77a-3f31-4cbf-a4a9-5c2ec3f3421c tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:30.698856 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-69b5a77a-3f31-4cbf-a4a9-5c2ec3f3421c tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:30.710565 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-69b5a77a-3f31-4cbf-a4a9-5c2ec3f3421c tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:30.710565 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-69b5a77a-3f31-4cbf-a4a9-5c2ec3f3421c tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:30.710565 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-69b5a77a-3f31-4cbf-a4a9-5c2ec3f3421c tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:30.710565 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-69b5a77a-3f31-4cbf-a4a9-5c2ec3f3421c tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:30.711012 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ba6fd600-e457-48f7-832a-2b59018f4f72 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:30.711733 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ba6fd600-e457-48f7-832a-2b59018f4f72 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:30.712220 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ba6fd600-e457-48f7-832a-2b59018f4f72 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:30.712643 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ba6fd600-e457-48f7-832a-2b59018f4f72 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:30.919526 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-69b5a77a-3f31-4cbf-a4a9-5c2ec3f3421c tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9dbe3b7fdd482681b6ab94c26f4e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d394882f294c6283721bcc6f8ff04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:12:30.923365 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-ba6fd600-e457-48f7-832a-2b59018f4f72 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08d81bcd5a4f43ce8b4839ee15cb163b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56bd2a662e34a6395117027b5c28c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:12:30.927411 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-69b5a77a-3f31-4cbf-a4a9-5c2ec3f3421c tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "GET /compute/v2.1/servers/6775b84f-c318-4b37-9fdf-e93e607dfa4e" status: 200 len: 1453 microversion: 2.1 time: 0.242061 Aug 11 11:12:30.928035 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 509/1033] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:12:30 2022] GET /compute/v2.1/servers/6775b84f-c318-4b37-9fdf-e93e607dfa4e => generated 1453 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:12:30.931079 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-ba6fd600-e457-48f7-832a-2b59018f4f72 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7a6694-e9a6-4914-a702-51fcc95a5233" status: 200 len: 1365 microversion: 2.1 time: 0.248438 Aug 11 11:12:30.931674 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 525/1034] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:12:30 2022] GET /compute/v2.1/servers/5a7a6694-e9a6-4914-a702-51fcc95a5233 => generated 1365 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:12:30.949977 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-a750e710-9832-4bae-a6a1-e27bbc2cc68a tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:12:30.949977 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-a750e710-9832-4bae-a6a1-e27bbc2cc68a tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: 6775b84f-c318-4b37-9fdf-e93e607dfa4e] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:12:30.955956 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a750e710-9832-4bae-a6a1-e27bbc2cc68a tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:30.956446 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a750e710-9832-4bae-a6a1-e27bbc2cc68a tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:30.956878 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a750e710-9832-4bae-a6a1-e27bbc2cc68a tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:30.957569 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a750e710-9832-4bae-a6a1-e27bbc2cc68a tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:30.958051 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a750e710-9832-4bae-a6a1-e27bbc2cc68a tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:30.958476 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a750e710-9832-4bae-a6a1-e27bbc2cc68a tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:31.097658 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-a750e710-9832-4bae-a6a1-e27bbc2cc68a tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9dbe3b7fdd482681b6ab94c26f4e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d394882f294c6283721bcc6f8ff04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:12:31.106033 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-a750e710-9832-4bae-a6a1-e27bbc2cc68a tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "GET /compute/v2.1/servers/6775b84f-c318-4b37-9fdf-e93e607dfa4e" status: 200 len: 1453 microversion: 2.1 time: 0.160985 Aug 11 11:12:31.106605 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 510/1035] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:12:30 2022] GET /compute/v2.1/servers/6775b84f-c318-4b37-9fdf-e93e607dfa4e => generated 1453 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:12:31.951307 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-0098d1f5-4221-4fd9-afd1-d9db9e64fd75 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:12:31.952145 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-0098d1f5-4221-4fd9-afd1-d9db9e64fd75 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: 5a7a6694-e9a6-4914-a702-51fcc95a5233] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:12:31.960131 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0098d1f5-4221-4fd9-afd1-d9db9e64fd75 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:31.960552 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0098d1f5-4221-4fd9-afd1-d9db9e64fd75 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:31.960981 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0098d1f5-4221-4fd9-afd1-d9db9e64fd75 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:31.961660 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0098d1f5-4221-4fd9-afd1-d9db9e64fd75 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:31.962108 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0098d1f5-4221-4fd9-afd1-d9db9e64fd75 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:31.962573 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0098d1f5-4221-4fd9-afd1-d9db9e64fd75 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:32.098460 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-0098d1f5-4221-4fd9-afd1-d9db9e64fd75 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08d81bcd5a4f43ce8b4839ee15cb163b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56bd2a662e34a6395117027b5c28c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:12:32.106907 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-0098d1f5-4221-4fd9-afd1-d9db9e64fd75 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7a6694-e9a6-4914-a702-51fcc95a5233" status: 200 len: 1365 microversion: 2.1 time: 0.159434 Aug 11 11:12:32.107470 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 526/1036] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:12:31 2022] GET /compute/v2.1/servers/5a7a6694-e9a6-4914-a702-51fcc95a5233 => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:12:33.127799 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-ea68a076-0655-4e7c-83d6-6aab03e934ad tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:12:33.128492 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-ea68a076-0655-4e7c-83d6-6aab03e934ad tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: 5a7a6694-e9a6-4914-a702-51fcc95a5233] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:12:33.135066 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ea68a076-0655-4e7c-83d6-6aab03e934ad tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:33.135542 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ea68a076-0655-4e7c-83d6-6aab03e934ad tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:33.135999 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ea68a076-0655-4e7c-83d6-6aab03e934ad tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:33.136682 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ea68a076-0655-4e7c-83d6-6aab03e934ad tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:33.137130 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ea68a076-0655-4e7c-83d6-6aab03e934ad tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:33.137587 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ea68a076-0655-4e7c-83d6-6aab03e934ad tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:33.286903 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-ea68a076-0655-4e7c-83d6-6aab03e934ad tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08d81bcd5a4f43ce8b4839ee15cb163b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56bd2a662e34a6395117027b5c28c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:12:33.288499 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-04b6859c-bab1-4de6-98af-06c59f20b5a8 req-8562517f-9b49-4475-848b-4eeb15dd4337 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6775b84f-c318-4b37-9fdf-e93e607dfa4e", "tag": "05193d12-2729-4079-9c68-2950747232ad"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:12:33.295151 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-ea68a076-0655-4e7c-83d6-6aab03e934ad tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7a6694-e9a6-4914-a702-51fcc95a5233" status: 200 len: 1365 microversion: 2.1 time: 0.171340 Aug 11 11:12:33.296065 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 511/1037] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:12:33 2022] GET /compute/v2.1/servers/5a7a6694-e9a6-4914-a702-51fcc95a5233 => generated 1365 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:12:33.300388 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-04b6859c-bab1-4de6-98af-06c59f20b5a8 req-8562517f-9b49-4475-848b-4eeb15dd4337 service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:33.300891 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-04b6859c-bab1-4de6-98af-06c59f20b5a8 req-8562517f-9b49-4475-848b-4eeb15dd4337 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:33.301318 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-04b6859c-bab1-4de6-98af-06c59f20b5a8 req-8562517f-9b49-4475-848b-4eeb15dd4337 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:33.312676 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-04b6859c-bab1-4de6-98af-06c59f20b5a8 req-8562517f-9b49-4475-848b-4eeb15dd4337 service nova] Creating event network-changed:05193d12-2729-4079-9c68-2950747232ad for instance 6775b84f-c318-4b37-9fdf-e93e607dfa4e on hv-cinder-82002 Aug 11 11:12:33.317736 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-04b6859c-bab1-4de6-98af-06c59f20b5a8 req-8562517f-9b49-4475-848b-4eeb15dd4337 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034412 Aug 11 11:12:33.318384 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 527/1038] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:12:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 11:12:34.318042 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-c357634b-6262-42d5-b00a-bcb29b27df44 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:12:34.320586 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-c357634b-6262-42d5-b00a-bcb29b27df44 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: 5a7a6694-e9a6-4914-a702-51fcc95a5233] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:12:34.328355 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c357634b-6262-42d5-b00a-bcb29b27df44 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:34.328851 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c357634b-6262-42d5-b00a-bcb29b27df44 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:34.329469 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c357634b-6262-42d5-b00a-bcb29b27df44 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:34.330734 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c357634b-6262-42d5-b00a-bcb29b27df44 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:34.331357 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c357634b-6262-42d5-b00a-bcb29b27df44 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:34.332016 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c357634b-6262-42d5-b00a-bcb29b27df44 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:34.536124 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-c357634b-6262-42d5-b00a-bcb29b27df44 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08d81bcd5a4f43ce8b4839ee15cb163b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56bd2a662e34a6395117027b5c28c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:12:34.543753 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-c357634b-6262-42d5-b00a-bcb29b27df44 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7a6694-e9a6-4914-a702-51fcc95a5233" status: 200 len: 1365 microversion: 2.1 time: 0.232122 Aug 11 11:12:34.544358 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 512/1039] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:12:34 2022] GET /compute/v2.1/servers/5a7a6694-e9a6-4914-a702-51fcc95a5233 => generated 1365 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:12:35.565901 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-d2892412-1117-4d6e-801d-aef2a16bbc57 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:12:35.566621 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-d2892412-1117-4d6e-801d-aef2a16bbc57 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: 5a7a6694-e9a6-4914-a702-51fcc95a5233] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:12:35.572706 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d2892412-1117-4d6e-801d-aef2a16bbc57 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:35.573174 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d2892412-1117-4d6e-801d-aef2a16bbc57 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:35.573597 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d2892412-1117-4d6e-801d-aef2a16bbc57 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:35.574370 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d2892412-1117-4d6e-801d-aef2a16bbc57 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:35.574816 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d2892412-1117-4d6e-801d-aef2a16bbc57 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:35.575313 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d2892412-1117-4d6e-801d-aef2a16bbc57 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:35.703852 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d2892412-1117-4d6e-801d-aef2a16bbc57 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08d81bcd5a4f43ce8b4839ee15cb163b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56bd2a662e34a6395117027b5c28c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:12:35.711931 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-d2892412-1117-4d6e-801d-aef2a16bbc57 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7a6694-e9a6-4914-a702-51fcc95a5233" status: 200 len: 1365 microversion: 2.1 time: 0.150964 Aug 11 11:12:35.712489 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 528/1040] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:12:35 2022] GET /compute/v2.1/servers/5a7a6694-e9a6-4914-a702-51fcc95a5233 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:12:36.732051 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-18569c40-44f7-40e1-a6e4-8b4f6cff17bd tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:12:36.732680 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-18569c40-44f7-40e1-a6e4-8b4f6cff17bd tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: 5a7a6694-e9a6-4914-a702-51fcc95a5233] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:12:36.741217 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-18569c40-44f7-40e1-a6e4-8b4f6cff17bd tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:36.744468 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-18569c40-44f7-40e1-a6e4-8b4f6cff17bd tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:36.744468 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-18569c40-44f7-40e1-a6e4-8b4f6cff17bd tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:36.744468 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-18569c40-44f7-40e1-a6e4-8b4f6cff17bd tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:36.744468 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-18569c40-44f7-40e1-a6e4-8b4f6cff17bd tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:36.744884 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-18569c40-44f7-40e1-a6e4-8b4f6cff17bd tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:36.762282 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell1:SELECT=100 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:12:37.128688 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-21630fa7-1635-4329-894a-cc9cd33c427c req-ccf92863-36a8-49bb-96cc-6447838286b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a7a6694-e9a6-4914-a702-51fcc95a5233", "name": "network-vif-plugged", "status": "completed", "tag": "adba626d-2eea-4612-bdc0-e917909acfe1"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:12:37.142318 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-21630fa7-1635-4329-894a-cc9cd33c427c req-ccf92863-36a8-49bb-96cc-6447838286b7 service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:37.142882 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-21630fa7-1635-4329-894a-cc9cd33c427c req-ccf92863-36a8-49bb-96cc-6447838286b7 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:37.143405 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-21630fa7-1635-4329-894a-cc9cd33c427c req-ccf92863-36a8-49bb-96cc-6447838286b7 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:37.151631 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-18569c40-44f7-40e1-a6e4-8b4f6cff17bd tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08d81bcd5a4f43ce8b4839ee15cb163b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56bd2a662e34a6395117027b5c28c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:12:37.158210 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-21630fa7-1635-4329-894a-cc9cd33c427c req-ccf92863-36a8-49bb-96cc-6447838286b7 service nova] Creating event network-vif-plugged:adba626d-2eea-4612-bdc0-e917909acfe1 for instance 5a7a6694-e9a6-4914-a702-51fcc95a5233 on hv-cinder-82002 Aug 11 11:12:37.159908 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-18569c40-44f7-40e1-a6e4-8b4f6cff17bd tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7a6694-e9a6-4914-a702-51fcc95a5233" status: 200 len: 1365 microversion: 2.1 time: 0.431645 Aug 11 11:12:37.160484 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 513/1041] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:12:36 2022] GET /compute/v2.1/servers/5a7a6694-e9a6-4914-a702-51fcc95a5233 => generated 1365 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:12:37.163540 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-21630fa7-1635-4329-894a-cc9cd33c427c req-ccf92863-36a8-49bb-96cc-6447838286b7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041227 Aug 11 11:12:37.164282 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 529/1042] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:12:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 11:12:38.181617 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-7880af99-ecd9-434b-8127-a7b686aa1bb2 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:12:38.182311 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-7880af99-ecd9-434b-8127-a7b686aa1bb2 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: 5a7a6694-e9a6-4914-a702-51fcc95a5233] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:12:38.188786 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7880af99-ecd9-434b-8127-a7b686aa1bb2 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:38.189259 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7880af99-ecd9-434b-8127-a7b686aa1bb2 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:38.189685 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7880af99-ecd9-434b-8127-a7b686aa1bb2 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:38.190363 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7880af99-ecd9-434b-8127-a7b686aa1bb2 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:38.190808 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7880af99-ecd9-434b-8127-a7b686aa1bb2 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:38.192961 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7880af99-ecd9-434b-8127-a7b686aa1bb2 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:38.327721 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-7880af99-ecd9-434b-8127-a7b686aa1bb2 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08d81bcd5a4f43ce8b4839ee15cb163b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56bd2a662e34a6395117027b5c28c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:12:38.335332 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-7880af99-ecd9-434b-8127-a7b686aa1bb2 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7a6694-e9a6-4914-a702-51fcc95a5233" status: 200 len: 1365 microversion: 2.1 time: 0.158238 Aug 11 11:12:38.336409 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 514/1043] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:12:38 2022] GET /compute/v2.1/servers/5a7a6694-e9a6-4914-a702-51fcc95a5233 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:12:39.357525 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-df281023-16bd-4997-8c7b-43b6f534d798 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:12:39.358221 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-df281023-16bd-4997-8c7b-43b6f534d798 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: 5a7a6694-e9a6-4914-a702-51fcc95a5233] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:12:39.364449 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-df281023-16bd-4997-8c7b-43b6f534d798 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:39.364926 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-df281023-16bd-4997-8c7b-43b6f534d798 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:39.365355 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-df281023-16bd-4997-8c7b-43b6f534d798 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:39.366032 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-df281023-16bd-4997-8c7b-43b6f534d798 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:39.366478 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-df281023-16bd-4997-8c7b-43b6f534d798 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:39.366896 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-df281023-16bd-4997-8c7b-43b6f534d798 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:39.493909 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-df281023-16bd-4997-8c7b-43b6f534d798 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08d81bcd5a4f43ce8b4839ee15cb163b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56bd2a662e34a6395117027b5c28c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:12:39.501281 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-df281023-16bd-4997-8c7b-43b6f534d798 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7a6694-e9a6-4914-a702-51fcc95a5233" status: 200 len: 1365 microversion: 2.1 time: 0.148616 Aug 11 11:12:39.501842 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 530/1044] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:12:39 2022] GET /compute/v2.1/servers/5a7a6694-e9a6-4914-a702-51fcc95a5233 => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:12:40.522013 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-5a90a495-b31e-4d4e-b8e3-138540233334 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:12:40.522546 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-5a90a495-b31e-4d4e-b8e3-138540233334 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: 5a7a6694-e9a6-4914-a702-51fcc95a5233] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:12:40.529530 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5a90a495-b31e-4d4e-b8e3-138540233334 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:40.530004 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5a90a495-b31e-4d4e-b8e3-138540233334 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:40.530477 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5a90a495-b31e-4d4e-b8e3-138540233334 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:40.531124 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5a90a495-b31e-4d4e-b8e3-138540233334 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:40.531585 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5a90a495-b31e-4d4e-b8e3-138540233334 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:40.532028 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5a90a495-b31e-4d4e-b8e3-138540233334 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:40.661354 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-5a90a495-b31e-4d4e-b8e3-138540233334 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08d81bcd5a4f43ce8b4839ee15cb163b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56bd2a662e34a6395117027b5c28c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:12:40.668724 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-5a90a495-b31e-4d4e-b8e3-138540233334 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7a6694-e9a6-4914-a702-51fcc95a5233" status: 200 len: 1365 microversion: 2.1 time: 0.150692 Aug 11 11:12:40.669284 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 515/1045] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:12:40 2022] GET /compute/v2.1/servers/5a7a6694-e9a6-4914-a702-51fcc95a5233 => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:12:41.689560 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-6a88bf73-c7d4-4306-b1cd-f1b0d478080a tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:12:41.690169 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-6a88bf73-c7d4-4306-b1cd-f1b0d478080a tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: 5a7a6694-e9a6-4914-a702-51fcc95a5233] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:12:41.702550 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6a88bf73-c7d4-4306-b1cd-f1b0d478080a tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:41.702550 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6a88bf73-c7d4-4306-b1cd-f1b0d478080a tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:41.702550 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6a88bf73-c7d4-4306-b1cd-f1b0d478080a tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:41.702550 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6a88bf73-c7d4-4306-b1cd-f1b0d478080a tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:41.702871 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6a88bf73-c7d4-4306-b1cd-f1b0d478080a tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:41.702871 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6a88bf73-c7d4-4306-b1cd-f1b0d478080a tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:41.834457 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-6a88bf73-c7d4-4306-b1cd-f1b0d478080a tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08d81bcd5a4f43ce8b4839ee15cb163b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56bd2a662e34a6395117027b5c28c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:12:41.842910 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-6a88bf73-c7d4-4306-b1cd-f1b0d478080a tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7a6694-e9a6-4914-a702-51fcc95a5233" status: 200 len: 1365 microversion: 2.1 time: 0.157218 Aug 11 11:12:41.845998 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 531/1046] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:12:41 2022] GET /compute/v2.1/servers/5a7a6694-e9a6-4914-a702-51fcc95a5233 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:12:42.864244 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-173d16ce-a490-4ad4-bf33-116bfeace06c tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:12:42.864841 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-173d16ce-a490-4ad4-bf33-116bfeace06c tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: 5a7a6694-e9a6-4914-a702-51fcc95a5233] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:12:42.871077 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-173d16ce-a490-4ad4-bf33-116bfeace06c tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:42.871561 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-173d16ce-a490-4ad4-bf33-116bfeace06c tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:42.872027 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-173d16ce-a490-4ad4-bf33-116bfeace06c tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:42.872714 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-173d16ce-a490-4ad4-bf33-116bfeace06c tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:42.873162 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-173d16ce-a490-4ad4-bf33-116bfeace06c tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:42.873582 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-173d16ce-a490-4ad4-bf33-116bfeace06c tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:43.004503 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-173d16ce-a490-4ad4-bf33-116bfeace06c tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08d81bcd5a4f43ce8b4839ee15cb163b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56bd2a662e34a6395117027b5c28c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:12:43.012046 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-173d16ce-a490-4ad4-bf33-116bfeace06c tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7a6694-e9a6-4914-a702-51fcc95a5233" status: 200 len: 1555 microversion: 2.1 time: 0.151705 Aug 11 11:12:43.012618 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 516/1047] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:12:42 2022] GET /compute/v2.1/servers/5a7a6694-e9a6-4914-a702-51fcc95a5233 => generated 1555 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:12:43.031958 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-807b076e-ef88-437d-9d7a-55d99c37bcfa tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:12:43.032472 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-807b076e-ef88-437d-9d7a-55d99c37bcfa tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: 5a7a6694-e9a6-4914-a702-51fcc95a5233] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:12:43.039864 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-807b076e-ef88-437d-9d7a-55d99c37bcfa tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:43.040340 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-807b076e-ef88-437d-9d7a-55d99c37bcfa tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:43.040777 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-807b076e-ef88-437d-9d7a-55d99c37bcfa tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:43.041461 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-807b076e-ef88-437d-9d7a-55d99c37bcfa tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:43.041908 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-807b076e-ef88-437d-9d7a-55d99c37bcfa tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:43.042329 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-807b076e-ef88-437d-9d7a-55d99c37bcfa tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:43.128817 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-807b076e-ef88-437d-9d7a-55d99c37bcfa tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7a6694-e9a6-4914-a702-51fcc95a5233/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.100700 Aug 11 11:12:43.129813 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 532/1048] 10.222.0.48 () {58 vars in 1275 bytes} [Thu Aug 11 11:12:43 2022] GET /compute/v2.1/servers/5a7a6694-e9a6-4914-a702-51fcc95a5233/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:12:44.134032 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-94659dc0-6748-4c3f-924f-b2311e6fcaa3 req-86f990de-8628-4474-ab89-7ed1cff2a344 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a7a6694-e9a6-4914-a702-51fcc95a5233", "tag": "adba626d-2eea-4612-bdc0-e917909acfe1"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:12:44.144073 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-94659dc0-6748-4c3f-924f-b2311e6fcaa3 req-86f990de-8628-4474-ab89-7ed1cff2a344 service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:44.144543 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-94659dc0-6748-4c3f-924f-b2311e6fcaa3 req-86f990de-8628-4474-ab89-7ed1cff2a344 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:44.144963 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-94659dc0-6748-4c3f-924f-b2311e6fcaa3 req-86f990de-8628-4474-ab89-7ed1cff2a344 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:44.156404 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-94659dc0-6748-4c3f-924f-b2311e6fcaa3 req-86f990de-8628-4474-ab89-7ed1cff2a344 service nova] Creating event network-changed:adba626d-2eea-4612-bdc0-e917909acfe1 for instance 5a7a6694-e9a6-4914-a702-51fcc95a5233 on hv-cinder-82002 Aug 11 11:12:44.161865 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-94659dc0-6748-4c3f-924f-b2311e6fcaa3 req-86f990de-8628-4474-ab89-7ed1cff2a344 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034433 Aug 11 11:12:44.162707 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 517/1049] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:12:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:12:49.440221 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-36be6738-13ac-4c4c-b15c-3e251ef9eb31 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:12:49.440801 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-36be6738-13ac-4c4c-b15c-3e251ef9eb31 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] [instance: 9c9f7edb-2175-4575-ac11-781015e25a57] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:12:49.447594 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-36be6738-13ac-4c4c-b15c-3e251ef9eb31 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:49.448323 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-36be6738-13ac-4c4c-b15c-3e251ef9eb31 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:49.451607 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-36be6738-13ac-4c4c-b15c-3e251ef9eb31 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:49.451607 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-36be6738-13ac-4c4c-b15c-3e251ef9eb31 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:49.451607 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-36be6738-13ac-4c4c-b15c-3e251ef9eb31 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:49.451607 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-36be6738-13ac-4c4c-b15c-3e251ef9eb31 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:49.473173 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.objects.instance [None req-36be6738-13ac-4c4c-b15c-3e251ef9eb31 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lazy-loading 'flavor' on Instance uuid 9c9f7edb-2175-4575-ac11-781015e25a57 {{(pid=121232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 11:12:49.744869 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-36be6738-13ac-4c4c-b15c-3e251ef9eb31 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] 10.222.0.48 "POST /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57/action" status: 202 len: 0 microversion: 2.1 time: 0.309162 Aug 11 11:12:49.745475 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 533/1050] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Aug 11 11:12:49 2022] POST /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57/action => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 11:12:49.755041 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-dd3f4165-8b1a-45f3-997c-3ea661ab83ed tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:12:49.755747 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-dd3f4165-8b1a-45f3-997c-3ea661ab83ed tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] [instance: 9c9f7edb-2175-4575-ac11-781015e25a57] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:12:49.762644 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-dd3f4165-8b1a-45f3-997c-3ea661ab83ed tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:49.763141 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-dd3f4165-8b1a-45f3-997c-3ea661ab83ed tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:49.763573 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-dd3f4165-8b1a-45f3-997c-3ea661ab83ed tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:49.764295 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-dd3f4165-8b1a-45f3-997c-3ea661ab83ed tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:49.764745 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-dd3f4165-8b1a-45f3-997c-3ea661ab83ed tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:49.765166 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-dd3f4165-8b1a-45f3-997c-3ea661ab83ed tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:49.901588 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-dd3f4165-8b1a-45f3-997c-3ea661ab83ed tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b2f7b56f6d94908bf00b3f21954776c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea40881648b4df393fc35c07d8f68dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:12:49.910374 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-dd3f4165-8b1a-45f3-997c-3ea661ab83ed tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] 10.222.0.48 "GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57" status: 200 len: 1568 microversion: 2.1 time: 0.160204 Aug 11 11:12:49.910965 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 518/1051] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:12:49 2022] GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57 => generated 1568 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:12:50.932639 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-0e43ac0a-1bca-4b06-ba16-3c7765c2592b tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:12:50.933333 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-0e43ac0a-1bca-4b06-ba16-3c7765c2592b tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] [instance: 9c9f7edb-2175-4575-ac11-781015e25a57] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:12:50.939548 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0e43ac0a-1bca-4b06-ba16-3c7765c2592b tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:50.940066 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0e43ac0a-1bca-4b06-ba16-3c7765c2592b tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:50.940497 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0e43ac0a-1bca-4b06-ba16-3c7765c2592b tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:50.941180 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0e43ac0a-1bca-4b06-ba16-3c7765c2592b tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:50.941625 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0e43ac0a-1bca-4b06-ba16-3c7765c2592b tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:50.942041 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0e43ac0a-1bca-4b06-ba16-3c7765c2592b tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:51.084117 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-0e43ac0a-1bca-4b06-ba16-3c7765c2592b tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b2f7b56f6d94908bf00b3f21954776c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea40881648b4df393fc35c07d8f68dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:12:51.092937 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-0e43ac0a-1bca-4b06-ba16-3c7765c2592b tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] 10.222.0.48 "GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57" status: 200 len: 1568 microversion: 2.1 time: 0.165009 Aug 11 11:12:51.093516 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 534/1052] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:12:50 2022] GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57 => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:12:52.117347 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-0b72f35b-ea77-4f7f-9ee8-7122a04c0337 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:12:52.118088 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-0b72f35b-ea77-4f7f-9ee8-7122a04c0337 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] [instance: 9c9f7edb-2175-4575-ac11-781015e25a57] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:12:52.124942 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0b72f35b-ea77-4f7f-9ee8-7122a04c0337 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:52.125422 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0b72f35b-ea77-4f7f-9ee8-7122a04c0337 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:52.125856 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0b72f35b-ea77-4f7f-9ee8-7122a04c0337 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:52.126550 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0b72f35b-ea77-4f7f-9ee8-7122a04c0337 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:52.126991 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0b72f35b-ea77-4f7f-9ee8-7122a04c0337 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:52.127410 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0b72f35b-ea77-4f7f-9ee8-7122a04c0337 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:52.294801 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-0b72f35b-ea77-4f7f-9ee8-7122a04c0337 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b2f7b56f6d94908bf00b3f21954776c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea40881648b4df393fc35c07d8f68dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:12:52.302719 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-0b72f35b-ea77-4f7f-9ee8-7122a04c0337 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] 10.222.0.48 "GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57" status: 200 len: 1568 microversion: 2.1 time: 0.192101 Aug 11 11:12:52.303383 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 519/1053] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:12:52 2022] GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57 => generated 1568 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:12:53.324223 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-32bbdf3b-cb43-4518-a12f-d89fb2a5d617 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:12:53.324755 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-32bbdf3b-cb43-4518-a12f-d89fb2a5d617 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] [instance: 9c9f7edb-2175-4575-ac11-781015e25a57] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:12:53.331261 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-32bbdf3b-cb43-4518-a12f-d89fb2a5d617 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:53.331738 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-32bbdf3b-cb43-4518-a12f-d89fb2a5d617 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:53.332194 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-32bbdf3b-cb43-4518-a12f-d89fb2a5d617 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:53.332875 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-32bbdf3b-cb43-4518-a12f-d89fb2a5d617 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:53.333321 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-32bbdf3b-cb43-4518-a12f-d89fb2a5d617 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:53.333741 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-32bbdf3b-cb43-4518-a12f-d89fb2a5d617 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:53.471884 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-32bbdf3b-cb43-4518-a12f-d89fb2a5d617 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b2f7b56f6d94908bf00b3f21954776c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea40881648b4df393fc35c07d8f68dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:12:53.478626 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-32bbdf3b-cb43-4518-a12f-d89fb2a5d617 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] 10.222.0.48 "GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57" status: 200 len: 1568 microversion: 2.1 time: 0.158204 Aug 11 11:12:53.479375 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 535/1054] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:12:53 2022] GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:12:54.503237 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-8ca2b506-84db-47a8-a011-2e12f1ef2764 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:12:54.503873 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-8ca2b506-84db-47a8-a011-2e12f1ef2764 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] [instance: 9c9f7edb-2175-4575-ac11-781015e25a57] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:12:54.510906 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8ca2b506-84db-47a8-a011-2e12f1ef2764 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:54.511387 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8ca2b506-84db-47a8-a011-2e12f1ef2764 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:54.511838 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8ca2b506-84db-47a8-a011-2e12f1ef2764 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:54.512529 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8ca2b506-84db-47a8-a011-2e12f1ef2764 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:54.512978 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8ca2b506-84db-47a8-a011-2e12f1ef2764 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:54.513400 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8ca2b506-84db-47a8-a011-2e12f1ef2764 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:54.655233 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-8ca2b506-84db-47a8-a011-2e12f1ef2764 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b2f7b56f6d94908bf00b3f21954776c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea40881648b4df393fc35c07d8f68dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:12:54.663296 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-8ca2b506-84db-47a8-a011-2e12f1ef2764 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] 10.222.0.48 "GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57" status: 200 len: 1568 microversion: 2.1 time: 0.163956 Aug 11 11:12:54.663894 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 520/1055] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:12:54 2022] GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:12:55.685235 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-cc97d68c-abe8-4f04-9891-e17f0ab87924 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:12:55.686169 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-cc97d68c-abe8-4f04-9891-e17f0ab87924 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] [instance: 9c9f7edb-2175-4575-ac11-781015e25a57] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:12:55.693019 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cc97d68c-abe8-4f04-9891-e17f0ab87924 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:55.693497 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cc97d68c-abe8-4f04-9891-e17f0ab87924 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:55.693955 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cc97d68c-abe8-4f04-9891-e17f0ab87924 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:55.694639 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cc97d68c-abe8-4f04-9891-e17f0ab87924 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:55.695088 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cc97d68c-abe8-4f04-9891-e17f0ab87924 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:55.695509 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cc97d68c-abe8-4f04-9891-e17f0ab87924 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:55.825385 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-cc97d68c-abe8-4f04-9891-e17f0ab87924 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b2f7b56f6d94908bf00b3f21954776c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea40881648b4df393fc35c07d8f68dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:12:55.832789 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-cc97d68c-abe8-4f04-9891-e17f0ab87924 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] 10.222.0.48 "GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57" status: 200 len: 1568 microversion: 2.1 time: 0.151737 Aug 11 11:12:55.833347 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 536/1056] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:12:55 2022] GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:12:56.856817 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-a56d43b1-fa62-4ce5-ab8b-c15e26bae399 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:12:56.857374 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-a56d43b1-fa62-4ce5-ab8b-c15e26bae399 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] [instance: 9c9f7edb-2175-4575-ac11-781015e25a57] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:12:56.863317 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a56d43b1-fa62-4ce5-ab8b-c15e26bae399 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:56.863839 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a56d43b1-fa62-4ce5-ab8b-c15e26bae399 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:56.864281 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a56d43b1-fa62-4ce5-ab8b-c15e26bae399 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:56.864976 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a56d43b1-fa62-4ce5-ab8b-c15e26bae399 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:56.865431 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a56d43b1-fa62-4ce5-ab8b-c15e26bae399 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:56.866424 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a56d43b1-fa62-4ce5-ab8b-c15e26bae399 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:56.999189 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-a56d43b1-fa62-4ce5-ab8b-c15e26bae399 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b2f7b56f6d94908bf00b3f21954776c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea40881648b4df393fc35c07d8f68dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:12:57.007503 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-a56d43b1-fa62-4ce5-ab8b-c15e26bae399 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] 10.222.0.48 "GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57" status: 200 len: 1568 microversion: 2.1 time: 0.156301 Aug 11 11:12:57.008125 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 521/1057] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:12:56 2022] GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:12:58.029220 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-998ffdf8-b426-44f9-ba82-ef9b3ff2b52f tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:12:58.029829 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-998ffdf8-b426-44f9-ba82-ef9b3ff2b52f tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] [instance: 9c9f7edb-2175-4575-ac11-781015e25a57] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:12:58.032375 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_api:SELECT=31 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:12:58.037331 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-998ffdf8-b426-44f9-ba82-ef9b3ff2b52f tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:58.037809 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-998ffdf8-b426-44f9-ba82-ef9b3ff2b52f tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:58.038244 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-998ffdf8-b426-44f9-ba82-ef9b3ff2b52f tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:58.038927 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-998ffdf8-b426-44f9-ba82-ef9b3ff2b52f tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:58.039376 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-998ffdf8-b426-44f9-ba82-ef9b3ff2b52f tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:58.039825 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-998ffdf8-b426-44f9-ba82-ef9b3ff2b52f tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:58.179479 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-998ffdf8-b426-44f9-ba82-ef9b3ff2b52f tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b2f7b56f6d94908bf00b3f21954776c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea40881648b4df393fc35c07d8f68dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:12:58.187286 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-998ffdf8-b426-44f9-ba82-ef9b3ff2b52f tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] 10.222.0.48 "GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57" status: 200 len: 1568 microversion: 2.1 time: 0.162024 Aug 11 11:12:58.187891 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 537/1058] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:12:58 2022] GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:12:59.210510 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-690d1f51-7bfe-48d4-9941-57b96fc58fc8 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:12:59.211159 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-690d1f51-7bfe-48d4-9941-57b96fc58fc8 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] [instance: 9c9f7edb-2175-4575-ac11-781015e25a57] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:12:59.213648 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_api:SELECT=31 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:12:59.218429 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-690d1f51-7bfe-48d4-9941-57b96fc58fc8 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:59.218960 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-690d1f51-7bfe-48d4-9941-57b96fc58fc8 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:59.219392 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-690d1f51-7bfe-48d4-9941-57b96fc58fc8 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:59.220102 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-690d1f51-7bfe-48d4-9941-57b96fc58fc8 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:12:59.220555 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-690d1f51-7bfe-48d4-9941-57b96fc58fc8 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:12:59.221031 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-690d1f51-7bfe-48d4-9941-57b96fc58fc8 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:12:59.373283 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-690d1f51-7bfe-48d4-9941-57b96fc58fc8 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b2f7b56f6d94908bf00b3f21954776c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea40881648b4df393fc35c07d8f68dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:12:59.380821 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-690d1f51-7bfe-48d4-9941-57b96fc58fc8 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] 10.222.0.48 "GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57" status: 200 len: 1568 microversion: 2.1 time: 0.174844 Aug 11 11:12:59.381975 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 522/1059] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:12:59 2022] GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57 => generated 1568 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:13:00.403249 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-804157e7-4595-4519-8cc3-f7a44a891860 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:13:00.411082 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-804157e7-4595-4519-8cc3-f7a44a891860 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] [instance: 9c9f7edb-2175-4575-ac11-781015e25a57] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:13:00.418904 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-804157e7-4595-4519-8cc3-f7a44a891860 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:00.419392 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-804157e7-4595-4519-8cc3-f7a44a891860 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:00.420401 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-804157e7-4595-4519-8cc3-f7a44a891860 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:00.420527 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-804157e7-4595-4519-8cc3-f7a44a891860 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:00.420985 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-804157e7-4595-4519-8cc3-f7a44a891860 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:00.421406 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-804157e7-4595-4519-8cc3-f7a44a891860 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:00.650211 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-804157e7-4595-4519-8cc3-f7a44a891860 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b2f7b56f6d94908bf00b3f21954776c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea40881648b4df393fc35c07d8f68dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:13:00.658166 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-804157e7-4595-4519-8cc3-f7a44a891860 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] 10.222.0.48 "GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57" status: 200 len: 1568 microversion: 2.1 time: 0.258604 Aug 11 11:13:00.658740 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 538/1060] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:13:00 2022] GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57 => generated 1568 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:13:01.680055 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-c14afce6-8729-4c5f-8a21-b03496f72f65 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:13:01.680695 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-c14afce6-8729-4c5f-8a21-b03496f72f65 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] [instance: 9c9f7edb-2175-4575-ac11-781015e25a57] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:13:01.686886 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c14afce6-8729-4c5f-8a21-b03496f72f65 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:01.687363 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c14afce6-8729-4c5f-8a21-b03496f72f65 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:01.687811 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c14afce6-8729-4c5f-8a21-b03496f72f65 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:01.692297 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c14afce6-8729-4c5f-8a21-b03496f72f65 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:01.692297 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c14afce6-8729-4c5f-8a21-b03496f72f65 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:01.692297 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c14afce6-8729-4c5f-8a21-b03496f72f65 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:01.824692 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-c14afce6-8729-4c5f-8a21-b03496f72f65 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b2f7b56f6d94908bf00b3f21954776c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea40881648b4df393fc35c07d8f68dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:13:01.832498 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-c14afce6-8729-4c5f-8a21-b03496f72f65 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] 10.222.0.48 "GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57" status: 200 len: 1568 microversion: 2.1 time: 0.156454 Aug 11 11:13:01.833098 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 523/1061] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:13:01 2022] GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:13:02.856007 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-5927c3d9-2076-4ac5-97d1-31a08d2e3049 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:13:02.856616 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-5927c3d9-2076-4ac5-97d1-31a08d2e3049 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] [instance: 9c9f7edb-2175-4575-ac11-781015e25a57] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:13:02.862994 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5927c3d9-2076-4ac5-97d1-31a08d2e3049 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:02.863473 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5927c3d9-2076-4ac5-97d1-31a08d2e3049 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:02.865913 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5927c3d9-2076-4ac5-97d1-31a08d2e3049 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:02.865913 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5927c3d9-2076-4ac5-97d1-31a08d2e3049 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:02.865913 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5927c3d9-2076-4ac5-97d1-31a08d2e3049 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:02.866197 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5927c3d9-2076-4ac5-97d1-31a08d2e3049 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:03.003644 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-5927c3d9-2076-4ac5-97d1-31a08d2e3049 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b2f7b56f6d94908bf00b3f21954776c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea40881648b4df393fc35c07d8f68dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:13:03.014837 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-5927c3d9-2076-4ac5-97d1-31a08d2e3049 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] 10.222.0.48 "GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57" status: 200 len: 1568 microversion: 2.1 time: 0.161822 Aug 11 11:13:03.014837 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 539/1062] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:13:02 2022] GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:13:04.035943 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-166e3229-1fdd-4e3c-ae65-3b101fe6059f tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:13:04.036550 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-166e3229-1fdd-4e3c-ae65-3b101fe6059f tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] [instance: 9c9f7edb-2175-4575-ac11-781015e25a57] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:13:04.043164 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-166e3229-1fdd-4e3c-ae65-3b101fe6059f tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:04.045382 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-166e3229-1fdd-4e3c-ae65-3b101fe6059f tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:04.045382 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-166e3229-1fdd-4e3c-ae65-3b101fe6059f tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:04.045382 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-166e3229-1fdd-4e3c-ae65-3b101fe6059f tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:04.045382 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-166e3229-1fdd-4e3c-ae65-3b101fe6059f tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:04.045813 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-166e3229-1fdd-4e3c-ae65-3b101fe6059f tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:04.206895 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-166e3229-1fdd-4e3c-ae65-3b101fe6059f tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b2f7b56f6d94908bf00b3f21954776c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea40881648b4df393fc35c07d8f68dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:13:04.217824 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-166e3229-1fdd-4e3c-ae65-3b101fe6059f tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] 10.222.0.48 "GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57" status: 200 len: 1569 microversion: 2.1 time: 0.185706 Aug 11 11:13:04.218688 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 524/1063] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:13:04 2022] GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57 => generated 1569 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:13:04.239642 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-048bb5fa-545c-42ab-807d-8b1f691a9867 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:13:04.240861 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-048bb5fa-545c-42ab-807d-8b1f691a9867 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] [instance: 9c9f7edb-2175-4575-ac11-781015e25a57] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:13:04.249532 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-048bb5fa-545c-42ab-807d-8b1f691a9867 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:04.250044 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-048bb5fa-545c-42ab-807d-8b1f691a9867 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:04.250480 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-048bb5fa-545c-42ab-807d-8b1f691a9867 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:04.251171 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-048bb5fa-545c-42ab-807d-8b1f691a9867 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:04.251622 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-048bb5fa-545c-42ab-807d-8b1f691a9867 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:04.252077 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-048bb5fa-545c-42ab-807d-8b1f691a9867 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:04.254568 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:13:04.294982 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-048bb5fa-545c-42ab-807d-8b1f691a9867 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] [instance: 9c9f7edb-2175-4575-ac11-781015e25a57] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121232) unshelve /opt/stack/nova/nova/compute/api.py:4544}} Aug 11 11:13:04.730186 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-048bb5fa-545c-42ab-807d-8b1f691a9867 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] 10.222.0.48 "POST /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57/action" status: 202 len: 0 microversion: 2.1 time: 0.494639 Aug 11 11:13:04.730784 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 540/1064] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Aug 11 11:13:04 2022] POST /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57/action => generated 0 bytes in 496 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 11:13:04.739088 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-2bc4e18c-d123-4c9d-bf60-7b67907fa542 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:13:04.739695 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-2bc4e18c-d123-4c9d-bf60-7b67907fa542 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] [instance: 9c9f7edb-2175-4575-ac11-781015e25a57] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:13:04.745646 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2bc4e18c-d123-4c9d-bf60-7b67907fa542 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:04.746126 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2bc4e18c-d123-4c9d-bf60-7b67907fa542 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:04.746560 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2bc4e18c-d123-4c9d-bf60-7b67907fa542 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:04.747254 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2bc4e18c-d123-4c9d-bf60-7b67907fa542 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:04.747702 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2bc4e18c-d123-4c9d-bf60-7b67907fa542 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:04.748274 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2bc4e18c-d123-4c9d-bf60-7b67907fa542 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:04.883278 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-2bc4e18c-d123-4c9d-bf60-7b67907fa542 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b2f7b56f6d94908bf00b3f21954776c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea40881648b4df393fc35c07d8f68dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:13:04.891087 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-2bc4e18c-d123-4c9d-bf60-7b67907fa542 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] 10.222.0.48 "GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57" status: 200 len: 1517 microversion: 2.1 time: 0.155966 Aug 11 11:13:04.892050 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 525/1065] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:13:04 2022] GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57 => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:13:05.914018 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-b0c72ec4-59e1-4e70-aab8-4d581d18090f tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:13:05.914637 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-b0c72ec4-59e1-4e70-aab8-4d581d18090f tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] [instance: 9c9f7edb-2175-4575-ac11-781015e25a57] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:13:05.920739 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b0c72ec4-59e1-4e70-aab8-4d581d18090f tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:05.921245 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b0c72ec4-59e1-4e70-aab8-4d581d18090f tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:05.921661 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b0c72ec4-59e1-4e70-aab8-4d581d18090f tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:05.922357 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b0c72ec4-59e1-4e70-aab8-4d581d18090f tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:05.922811 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b0c72ec4-59e1-4e70-aab8-4d581d18090f tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:05.923235 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b0c72ec4-59e1-4e70-aab8-4d581d18090f tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:06.066147 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-b0c72ec4-59e1-4e70-aab8-4d581d18090f tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b2f7b56f6d94908bf00b3f21954776c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea40881648b4df393fc35c07d8f68dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:13:06.067652 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-b0c72ec4-59e1-4e70-aab8-4d581d18090f tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] 10.222.0.48 "GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57" status: 200 len: 1519 microversion: 2.1 time: 0.158808 Aug 11 11:13:06.068259 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 541/1066] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:13:05 2022] GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:13:07.055123 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-6c3f34ed-d1c7-4c6f-888b-73aab5b0ba97 req-acc987ff-2e04-4ec8-b3eb-0b1052f6b27f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c9f7edb-2175-4575-ac11-781015e25a57", "name": "network-vif-unplugged", "status": "completed", "tag": "c6b87a06-7611-406e-8113-f1a3bada6e72"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:13:07.066107 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-6c3f34ed-d1c7-4c6f-888b-73aab5b0ba97 req-acc987ff-2e04-4ec8-b3eb-0b1052f6b27f service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:07.066674 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-6c3f34ed-d1c7-4c6f-888b-73aab5b0ba97 req-acc987ff-2e04-4ec8-b3eb-0b1052f6b27f service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:07.067029 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-6c3f34ed-d1c7-4c6f-888b-73aab5b0ba97 req-acc987ff-2e04-4ec8-b3eb-0b1052f6b27f service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:07.071024 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell1:SELECT=71 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:13:07.079473 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.compute.server_external_events [req-6c3f34ed-d1c7-4c6f-888b-73aab5b0ba97 req-acc987ff-2e04-4ec8-b3eb-0b1052f6b27f service nova] Unable to find a host for instance 9c9f7edb-2175-4575-ac11-781015e25a57. Dropping event network-vif-unplugged {{(pid=121231) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 11 11:13:07.080383 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-6c3f34ed-d1c7-4c6f-888b-73aab5b0ba97 req-acc987ff-2e04-4ec8-b3eb-0b1052f6b27f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031326 Aug 11 11:13:07.081200 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 526/1067] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:13:07 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 11 11:13:07.089804 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-1f8a1ca3-685a-40ea-84b7-3db66f62c4ac tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:13:07.091573 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-1f8a1ca3-685a-40ea-84b7-3db66f62c4ac tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] [instance: 9c9f7edb-2175-4575-ac11-781015e25a57] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:13:07.098160 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1f8a1ca3-685a-40ea-84b7-3db66f62c4ac tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:07.098635 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1f8a1ca3-685a-40ea-84b7-3db66f62c4ac tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:07.099120 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1f8a1ca3-685a-40ea-84b7-3db66f62c4ac tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:07.100350 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1f8a1ca3-685a-40ea-84b7-3db66f62c4ac tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:07.100813 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1f8a1ca3-685a-40ea-84b7-3db66f62c4ac tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:07.101217 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1f8a1ca3-685a-40ea-84b7-3db66f62c4ac tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:07.249638 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-1f8a1ca3-685a-40ea-84b7-3db66f62c4ac tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b2f7b56f6d94908bf00b3f21954776c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea40881648b4df393fc35c07d8f68dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:13:07.259474 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-1f8a1ca3-685a-40ea-84b7-3db66f62c4ac tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] 10.222.0.48 "GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57" status: 200 len: 1519 microversion: 2.1 time: 0.173483 Aug 11 11:13:07.263141 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 542/1068] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:13:07 2022] GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57 => generated 1519 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:13:08.283098 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-44bdc1e3-3f0c-45a5-8d21-5693f272a706 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:13:08.283736 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-44bdc1e3-3f0c-45a5-8d21-5693f272a706 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] [instance: 9c9f7edb-2175-4575-ac11-781015e25a57] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:13:08.290490 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-44bdc1e3-3f0c-45a5-8d21-5693f272a706 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:08.291021 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-44bdc1e3-3f0c-45a5-8d21-5693f272a706 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:08.291456 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-44bdc1e3-3f0c-45a5-8d21-5693f272a706 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:08.292170 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-44bdc1e3-3f0c-45a5-8d21-5693f272a706 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:08.292617 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-44bdc1e3-3f0c-45a5-8d21-5693f272a706 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:08.293035 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-44bdc1e3-3f0c-45a5-8d21-5693f272a706 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:08.591013 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-44bdc1e3-3f0c-45a5-8d21-5693f272a706 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b2f7b56f6d94908bf00b3f21954776c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea40881648b4df393fc35c07d8f68dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:13:08.598622 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-44bdc1e3-3f0c-45a5-8d21-5693f272a706 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] 10.222.0.48 "GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57" status: 200 len: 1575 microversion: 2.1 time: 0.320580 Aug 11 11:13:08.599806 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 527/1069] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:13:08 2022] GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57 => generated 1575 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:13:09.620289 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-087f6133-0982-4e7f-bd50-f9403497514e tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:13:09.620904 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-087f6133-0982-4e7f-bd50-f9403497514e tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] [instance: 9c9f7edb-2175-4575-ac11-781015e25a57] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:13:09.626925 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-087f6133-0982-4e7f-bd50-f9403497514e tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:09.627396 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-087f6133-0982-4e7f-bd50-f9403497514e tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:09.627919 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-087f6133-0982-4e7f-bd50-f9403497514e tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:09.629399 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-087f6133-0982-4e7f-bd50-f9403497514e tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:09.629848 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-087f6133-0982-4e7f-bd50-f9403497514e tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:09.630858 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-087f6133-0982-4e7f-bd50-f9403497514e tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:09.765550 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-087f6133-0982-4e7f-bd50-f9403497514e tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b2f7b56f6d94908bf00b3f21954776c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea40881648b4df393fc35c07d8f68dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:13:09.773539 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-087f6133-0982-4e7f-bd50-f9403497514e tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] 10.222.0.48 "GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57" status: 200 len: 1575 microversion: 2.1 time: 0.157366 Aug 11 11:13:09.774121 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 543/1070] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:13:09 2022] GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57 => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:13:10.799810 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-ffd54612-a431-4b2c-a206-6baf63a096ed tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:13:10.801230 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-ffd54612-a431-4b2c-a206-6baf63a096ed tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] [instance: 9c9f7edb-2175-4575-ac11-781015e25a57] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:13:10.808823 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ffd54612-a431-4b2c-a206-6baf63a096ed tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:10.809302 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ffd54612-a431-4b2c-a206-6baf63a096ed tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:10.809777 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ffd54612-a431-4b2c-a206-6baf63a096ed tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:10.810475 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ffd54612-a431-4b2c-a206-6baf63a096ed tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:10.810934 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ffd54612-a431-4b2c-a206-6baf63a096ed tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:10.811352 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ffd54612-a431-4b2c-a206-6baf63a096ed tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:10.952798 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-ffd54612-a431-4b2c-a206-6baf63a096ed tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b2f7b56f6d94908bf00b3f21954776c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea40881648b4df393fc35c07d8f68dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:13:10.961496 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-ffd54612-a431-4b2c-a206-6baf63a096ed tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] 10.222.0.48 "GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57" status: 200 len: 1575 microversion: 2.1 time: 0.165751 Aug 11 11:13:10.962058 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 528/1071] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:13:10 2022] GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57 => generated 1575 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:13:11.969921 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-38c1c3f1-7d1e-4d61-acd3-088811e94bd4 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1001643179", "imageRef": "05993162-aafd-4f1d-b781-ec09593713e5", "flavorRef": "452", "networks": [{"uuid": "887e1af0-fd80-4efb-9d61-69a5bed3e530"}]}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:13:11.988122 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-675c828e-572b-48b6-bcde-ff906dc068bf tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:13:11.989625 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-675c828e-572b-48b6-bcde-ff906dc068bf tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] [instance: 9c9f7edb-2175-4575-ac11-781015e25a57] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:13:11.996092 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-675c828e-572b-48b6-bcde-ff906dc068bf tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:11.996595 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-675c828e-572b-48b6-bcde-ff906dc068bf tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:11.997802 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-675c828e-572b-48b6-bcde-ff906dc068bf tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:11.998545 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-675c828e-572b-48b6-bcde-ff906dc068bf tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:11.999047 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-675c828e-572b-48b6-bcde-ff906dc068bf tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:11.999468 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-675c828e-572b-48b6-bcde-ff906dc068bf tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:12.023980 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.network.neutron [None req-38c1c3f1-7d1e-4d61-acd3-088811e94bd4 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] validate_networks() for [('887e1af0-fd80-4efb-9d61-69a5bed3e530', None, None, None, None, None)] {{(pid=121232) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 11 11:13:12.247360 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-675c828e-572b-48b6-bcde-ff906dc068bf tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b2f7b56f6d94908bf00b3f21954776c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea40881648b4df393fc35c07d8f68dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:13:12.247360 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-675c828e-572b-48b6-bcde-ff906dc068bf tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] 10.222.0.48 "GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57" status: 200 len: 1575 microversion: 2.1 time: 0.252635 Aug 11 11:13:12.247360 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 529/1072] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:13:11 2022] GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57 => generated 1575 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:13:12.703843 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-38c1c3f1-7d1e-4d61-acd3-088811e94bd4 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Flavor limits 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 11 11:13:12.704297 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-38c1c3f1-7d1e-4d61-acd3-088811e94bd4 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Image limits 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 11 11:13:12.704799 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-38c1c3f1-7d1e-4d61-acd3-088811e94bd4 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Flavor pref 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 11 11:13:12.705362 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-38c1c3f1-7d1e-4d61-acd3-088811e94bd4 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Image pref 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 11 11:13:12.705770 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-38c1c3f1-7d1e-4d61-acd3-088811e94bd4 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 11 11:13:12.714886 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-38c1c3f1-7d1e-4d61-acd3-088811e94bd4 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:12.715511 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-38c1c3f1-7d1e-4d61-acd3-088811e94bd4 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:12.716001 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-38c1c3f1-7d1e-4d61-acd3-088811e94bd4 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:12.716722 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-38c1c3f1-7d1e-4d61-acd3-088811e94bd4 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:12.717172 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-38c1c3f1-7d1e-4d61-acd3-088811e94bd4 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:12.717594 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-38c1c3f1-7d1e-4d61-acd3-088811e94bd4 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:12.737717 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-38c1c3f1-7d1e-4d61-acd3-088811e94bd4 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Getting quotas for project b84146bd4aa1425c843ad28653586d7a. Resources: {'ram', 'cores', 'instances'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 11:13:12.739911 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-38c1c3f1-7d1e-4d61-acd3-088811e94bd4 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Getting quotas for user 172fb1dca7c24ffdba4d10b34ba45fe5 and project b84146bd4aa1425c843ad28653586d7a. Resources: {'ram', 'cores', 'instances'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 11:13:12.751699 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-38c1c3f1-7d1e-4d61-acd3-088811e94bd4 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Going to run 1 instances... {{(pid=121232) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 11 11:13:12.754095 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-38c1c3f1-7d1e-4d61-acd3-088811e94bd4 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] [instance: e4543ff2-0618-457d-b0db-013b6b636f0c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='05993162-aafd-4f1d-b781-ec09593713e5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121232) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 11 11:13:12.912159 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-38c1c3f1-7d1e-4d61-acd3-088811e94bd4 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.945945 Aug 11 11:13:12.912810 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 544/1073] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Aug 11 11:13:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 947 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 11 11:13:12.923428 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-869317c1-dd9c-4903-b19c-176fde9d080d tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:13:12.924064 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-869317c1-dd9c-4903-b19c-176fde9d080d tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] [instance: e4543ff2-0618-457d-b0db-013b6b636f0c] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:13:12.978347 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-869317c1-dd9c-4903-b19c-176fde9d080d tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172fb1dca7c24ffdba4d10b34ba45fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84146bd4aa1425c843ad28653586d7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:13:12.985145 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-869317c1-dd9c-4903-b19c-176fde9d080d tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] 10.222.0.48 "GET /compute/v2.1/servers/e4543ff2-0618-457d-b0db-013b6b636f0c" status: 200 len: 1214 microversion: 2.1 time: 0.065548 Aug 11 11:13:12.989150 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 530/1074] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:13:12 2022] GET /compute/v2.1/servers/e4543ff2-0618-457d-b0db-013b6b636f0c => generated 1214 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:13:13.259538 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-7986ad1c-d1b3-4f41-8e4c-349f45023ad7 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:13:13.260204 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-7986ad1c-d1b3-4f41-8e4c-349f45023ad7 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] [instance: 9c9f7edb-2175-4575-ac11-781015e25a57] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:13:13.266247 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7986ad1c-d1b3-4f41-8e4c-349f45023ad7 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:13.266730 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7986ad1c-d1b3-4f41-8e4c-349f45023ad7 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:13.267166 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7986ad1c-d1b3-4f41-8e4c-349f45023ad7 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:13.267894 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7986ad1c-d1b3-4f41-8e4c-349f45023ad7 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:13.268348 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7986ad1c-d1b3-4f41-8e4c-349f45023ad7 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:13.268770 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7986ad1c-d1b3-4f41-8e4c-349f45023ad7 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:13.459528 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-7986ad1c-d1b3-4f41-8e4c-349f45023ad7 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b2f7b56f6d94908bf00b3f21954776c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea40881648b4df393fc35c07d8f68dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:13:13.467164 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-7986ad1c-d1b3-4f41-8e4c-349f45023ad7 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] 10.222.0.48 "GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57" status: 200 len: 1575 microversion: 2.1 time: 0.212516 Aug 11 11:13:13.467735 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 545/1075] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:13:13 2022] GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57 => generated 1575 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:13:14.005727 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-8475d853-67e3-4cb7-ac20-be9a7e51a080 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:13:14.006395 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-8475d853-67e3-4cb7-ac20-be9a7e51a080 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] [instance: e4543ff2-0618-457d-b0db-013b6b636f0c] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:13:14.060719 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-8475d853-67e3-4cb7-ac20-be9a7e51a080 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172fb1dca7c24ffdba4d10b34ba45fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84146bd4aa1425c843ad28653586d7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:13:14.067465 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-8475d853-67e3-4cb7-ac20-be9a7e51a080 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] 10.222.0.48 "GET /compute/v2.1/servers/e4543ff2-0618-457d-b0db-013b6b636f0c" status: 200 len: 1214 microversion: 2.1 time: 0.065697 Aug 11 11:13:14.068412 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 531/1076] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:13:14 2022] GET /compute/v2.1/servers/e4543ff2-0618-457d-b0db-013b6b636f0c => generated 1214 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:13:14.488519 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-29e0245f-3cd4-44a7-a0b9-56896b61b421 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:13:14.489051 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-29e0245f-3cd4-44a7-a0b9-56896b61b421 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] [instance: 9c9f7edb-2175-4575-ac11-781015e25a57] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:13:14.495616 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-29e0245f-3cd4-44a7-a0b9-56896b61b421 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:14.496131 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-29e0245f-3cd4-44a7-a0b9-56896b61b421 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:14.496563 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-29e0245f-3cd4-44a7-a0b9-56896b61b421 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:14.497387 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-29e0245f-3cd4-44a7-a0b9-56896b61b421 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:14.497838 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-29e0245f-3cd4-44a7-a0b9-56896b61b421 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:14.498264 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-29e0245f-3cd4-44a7-a0b9-56896b61b421 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:14.641285 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-29e0245f-3cd4-44a7-a0b9-56896b61b421 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b2f7b56f6d94908bf00b3f21954776c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea40881648b4df393fc35c07d8f68dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:13:14.649344 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-29e0245f-3cd4-44a7-a0b9-56896b61b421 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] 10.222.0.48 "GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57" status: 200 len: 1575 microversion: 2.1 time: 0.164909 Aug 11 11:13:14.650251 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 546/1077] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:13:14 2022] GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57 => generated 1575 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:13:15.088170 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-37def767-d8a4-4d8e-8783-ae4ecdc71b9a tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:13:15.088803 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-37def767-d8a4-4d8e-8783-ae4ecdc71b9a tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] [instance: e4543ff2-0618-457d-b0db-013b6b636f0c] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:13:15.095411 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-37def767-d8a4-4d8e-8783-ae4ecdc71b9a tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:15.095937 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-37def767-d8a4-4d8e-8783-ae4ecdc71b9a tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:15.096372 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-37def767-d8a4-4d8e-8783-ae4ecdc71b9a tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:15.097160 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-37def767-d8a4-4d8e-8783-ae4ecdc71b9a tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:15.097612 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-37def767-d8a4-4d8e-8783-ae4ecdc71b9a tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:15.098310 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-37def767-d8a4-4d8e-8783-ae4ecdc71b9a tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:15.162197 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-37def767-d8a4-4d8e-8783-ae4ecdc71b9a tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172fb1dca7c24ffdba4d10b34ba45fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84146bd4aa1425c843ad28653586d7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:13:15.169796 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-37def767-d8a4-4d8e-8783-ae4ecdc71b9a tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] 10.222.0.48 "GET /compute/v2.1/servers/e4543ff2-0618-457d-b0db-013b6b636f0c" status: 200 len: 1210 microversion: 2.1 time: 0.085693 Aug 11 11:13:15.170611 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 532/1078] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:13:15 2022] GET /compute/v2.1/servers/e4543ff2-0618-457d-b0db-013b6b636f0c => generated 1210 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:13:15.670566 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-dde22259-091d-40b7-926a-d7c5819edf65 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:13:15.671165 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-dde22259-091d-40b7-926a-d7c5819edf65 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] [instance: 9c9f7edb-2175-4575-ac11-781015e25a57] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:13:15.677646 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dde22259-091d-40b7-926a-d7c5819edf65 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:15.678125 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dde22259-091d-40b7-926a-d7c5819edf65 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:15.678549 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dde22259-091d-40b7-926a-d7c5819edf65 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:15.679827 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dde22259-091d-40b7-926a-d7c5819edf65 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:15.680277 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dde22259-091d-40b7-926a-d7c5819edf65 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:15.680696 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-dde22259-091d-40b7-926a-d7c5819edf65 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:15.814000 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-dde22259-091d-40b7-926a-d7c5819edf65 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b2f7b56f6d94908bf00b3f21954776c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea40881648b4df393fc35c07d8f68dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:13:15.821686 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-dde22259-091d-40b7-926a-d7c5819edf65 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] 10.222.0.48 "GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57" status: 200 len: 1575 microversion: 2.1 time: 0.155028 Aug 11 11:13:15.822270 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 547/1079] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:13:15 2022] GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:13:16.190988 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-98c2a94a-d1d6-4a4a-a17a-bb15314acf6b tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:13:16.195439 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-98c2a94a-d1d6-4a4a-a17a-bb15314acf6b tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] [instance: e4543ff2-0618-457d-b0db-013b6b636f0c] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:13:16.205186 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-98c2a94a-d1d6-4a4a-a17a-bb15314acf6b tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:16.205911 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-98c2a94a-d1d6-4a4a-a17a-bb15314acf6b tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:16.206806 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-98c2a94a-d1d6-4a4a-a17a-bb15314acf6b tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:16.207921 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-98c2a94a-d1d6-4a4a-a17a-bb15314acf6b tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:16.208877 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-98c2a94a-d1d6-4a4a-a17a-bb15314acf6b tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:16.209580 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-98c2a94a-d1d6-4a4a-a17a-bb15314acf6b tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:16.291134 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-98c2a94a-d1d6-4a4a-a17a-bb15314acf6b tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172fb1dca7c24ffdba4d10b34ba45fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84146bd4aa1425c843ad28653586d7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:13:16.298839 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-98c2a94a-d1d6-4a4a-a17a-bb15314acf6b tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] 10.222.0.48 "GET /compute/v2.1/servers/e4543ff2-0618-457d-b0db-013b6b636f0c" status: 200 len: 1274 microversion: 2.1 time: 0.112041 Aug 11 11:13:16.299556 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 533/1080] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:13:16 2022] GET /compute/v2.1/servers/e4543ff2-0618-457d-b0db-013b6b636f0c => generated 1274 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:13:16.842422 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-541506c1-ac90-4743-b6c3-c40252b02f2a tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:13:16.844261 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-541506c1-ac90-4743-b6c3-c40252b02f2a tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] [instance: 9c9f7edb-2175-4575-ac11-781015e25a57] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:13:16.849627 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-541506c1-ac90-4743-b6c3-c40252b02f2a tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:16.850105 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-541506c1-ac90-4743-b6c3-c40252b02f2a tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:16.850567 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-541506c1-ac90-4743-b6c3-c40252b02f2a tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:16.851256 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-541506c1-ac90-4743-b6c3-c40252b02f2a tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:16.851731 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-541506c1-ac90-4743-b6c3-c40252b02f2a tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:16.852186 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-541506c1-ac90-4743-b6c3-c40252b02f2a tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:17.079392 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-541506c1-ac90-4743-b6c3-c40252b02f2a tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b2f7b56f6d94908bf00b3f21954776c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea40881648b4df393fc35c07d8f68dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:13:17.087859 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-541506c1-ac90-4743-b6c3-c40252b02f2a tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] 10.222.0.48 "GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57" status: 200 len: 1575 microversion: 2.1 time: 0.249281 Aug 11 11:13:17.088870 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 548/1081] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:13:16 2022] GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57 => generated 1575 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:13:17.324910 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-6a26af66-3495-493d-b1c3-2ac6cfb4af30 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:13:17.325823 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-6a26af66-3495-493d-b1c3-2ac6cfb4af30 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] [instance: e4543ff2-0618-457d-b0db-013b6b636f0c] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:13:17.334204 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6a26af66-3495-493d-b1c3-2ac6cfb4af30 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:17.334991 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6a26af66-3495-493d-b1c3-2ac6cfb4af30 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:17.335913 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6a26af66-3495-493d-b1c3-2ac6cfb4af30 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:17.337349 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6a26af66-3495-493d-b1c3-2ac6cfb4af30 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:17.337991 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6a26af66-3495-493d-b1c3-2ac6cfb4af30 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:17.338597 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6a26af66-3495-493d-b1c3-2ac6cfb4af30 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:17.594729 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-6a26af66-3495-493d-b1c3-2ac6cfb4af30 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172fb1dca7c24ffdba4d10b34ba45fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84146bd4aa1425c843ad28653586d7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:13:17.608200 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-6a26af66-3495-493d-b1c3-2ac6cfb4af30 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] 10.222.0.48 "GET /compute/v2.1/servers/e4543ff2-0618-457d-b0db-013b6b636f0c" status: 200 len: 1314 microversion: 2.1 time: 0.287249 Aug 11 11:13:17.609312 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 534/1082] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:13:17 2022] GET /compute/v2.1/servers/e4543ff2-0618-457d-b0db-013b6b636f0c => generated 1314 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:13:18.109926 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-2af0f615-4cb2-471f-87ea-031492f18d46 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:13:18.110484 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-2af0f615-4cb2-471f-87ea-031492f18d46 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] [instance: 9c9f7edb-2175-4575-ac11-781015e25a57] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:13:18.116828 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2af0f615-4cb2-471f-87ea-031492f18d46 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:18.117301 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2af0f615-4cb2-471f-87ea-031492f18d46 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:18.117728 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2af0f615-4cb2-471f-87ea-031492f18d46 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:18.118404 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2af0f615-4cb2-471f-87ea-031492f18d46 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:18.118862 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2af0f615-4cb2-471f-87ea-031492f18d46 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:18.119264 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2af0f615-4cb2-471f-87ea-031492f18d46 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:18.219169 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-f38120d8-4bb9-4eeb-8b18-2f3d53b38522 req-beec21ac-fdab-441f-b2dc-92cb20e22769 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4543ff2-0618-457d-b0db-013b6b636f0c", "tag": "8d958282-d0a9-499c-a269-b09d16821c64"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:13:18.229897 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-f38120d8-4bb9-4eeb-8b18-2f3d53b38522 req-beec21ac-fdab-441f-b2dc-92cb20e22769 service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:18.230388 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-f38120d8-4bb9-4eeb-8b18-2f3d53b38522 req-beec21ac-fdab-441f-b2dc-92cb20e22769 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:18.230791 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-f38120d8-4bb9-4eeb-8b18-2f3d53b38522 req-beec21ac-fdab-441f-b2dc-92cb20e22769 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:18.242721 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-f38120d8-4bb9-4eeb-8b18-2f3d53b38522 req-beec21ac-fdab-441f-b2dc-92cb20e22769 service nova] Creating event network-changed:8d958282-d0a9-499c-a269-b09d16821c64 for instance e4543ff2-0618-457d-b0db-013b6b636f0c on hv-cinder-82002 Aug 11 11:13:18.248418 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-f38120d8-4bb9-4eeb-8b18-2f3d53b38522 req-beec21ac-fdab-441f-b2dc-92cb20e22769 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033237 Aug 11 11:13:18.249108 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 535/1083] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:13:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 11:13:18.303912 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-2af0f615-4cb2-471f-87ea-031492f18d46 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b2f7b56f6d94908bf00b3f21954776c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea40881648b4df393fc35c07d8f68dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:13:18.311967 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-2af0f615-4cb2-471f-87ea-031492f18d46 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] 10.222.0.48 "GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57" status: 200 len: 1575 microversion: 2.1 time: 0.205973 Aug 11 11:13:18.312573 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 549/1084] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:13:18 2022] GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57 => generated 1575 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:13:18.639688 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-ec3763de-9f6c-4041-9d74-d448a188c616 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:13:18.640404 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-ec3763de-9f6c-4041-9d74-d448a188c616 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] [instance: e4543ff2-0618-457d-b0db-013b6b636f0c] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:13:18.647208 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ec3763de-9f6c-4041-9d74-d448a188c616 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:18.647683 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ec3763de-9f6c-4041-9d74-d448a188c616 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:18.648363 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ec3763de-9f6c-4041-9d74-d448a188c616 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:18.649053 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ec3763de-9f6c-4041-9d74-d448a188c616 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:18.649514 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ec3763de-9f6c-4041-9d74-d448a188c616 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:18.650575 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ec3763de-9f6c-4041-9d74-d448a188c616 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:18.896896 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-ec3763de-9f6c-4041-9d74-d448a188c616 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172fb1dca7c24ffdba4d10b34ba45fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84146bd4aa1425c843ad28653586d7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:13:18.904432 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-ec3763de-9f6c-4041-9d74-d448a188c616 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] 10.222.0.48 "GET /compute/v2.1/servers/e4543ff2-0618-457d-b0db-013b6b636f0c" status: 200 len: 1314 microversion: 2.1 time: 0.269814 Aug 11 11:13:18.904998 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 536/1085] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:13:18 2022] GET /compute/v2.1/servers/e4543ff2-0618-457d-b0db-013b6b636f0c => generated 1314 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:13:19.126454 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-2e97ae5e-f2ad-4046-8865-9f75bf353bee req-add90c27-bda7-4973-a634-4e4a2b198b9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c9f7edb-2175-4575-ac11-781015e25a57", "name": "network-vif-plugged", "status": "completed", "tag": "c6b87a06-7611-406e-8113-f1a3bada6e72"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:13:19.137407 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-2e97ae5e-f2ad-4046-8865-9f75bf353bee req-add90c27-bda7-4973-a634-4e4a2b198b9e service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:19.147279 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-2e97ae5e-f2ad-4046-8865-9f75bf353bee req-add90c27-bda7-4973-a634-4e4a2b198b9e service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:19.147279 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-2e97ae5e-f2ad-4046-8865-9f75bf353bee req-add90c27-bda7-4973-a634-4e4a2b198b9e service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:19.149342 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-2e97ae5e-f2ad-4046-8865-9f75bf353bee req-add90c27-bda7-4973-a634-4e4a2b198b9e service nova] Creating event network-vif-plugged:c6b87a06-7611-406e-8113-f1a3bada6e72 for instance 9c9f7edb-2175-4575-ac11-781015e25a57 on hv-cinder-82002 Aug 11 11:13:19.154509 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-2e97ae5e-f2ad-4046-8865-9f75bf353bee req-add90c27-bda7-4973-a634-4e4a2b198b9e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031926 Aug 11 11:13:19.155163 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 550/1086] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:13:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 11:13:19.334594 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-8ec24ba3-1cfb-4154-a11f-dbf18762e356 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:13:19.335206 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-8ec24ba3-1cfb-4154-a11f-dbf18762e356 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] [instance: 9c9f7edb-2175-4575-ac11-781015e25a57] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:13:19.341152 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8ec24ba3-1cfb-4154-a11f-dbf18762e356 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:19.341719 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8ec24ba3-1cfb-4154-a11f-dbf18762e356 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:19.342071 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8ec24ba3-1cfb-4154-a11f-dbf18762e356 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:19.342765 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8ec24ba3-1cfb-4154-a11f-dbf18762e356 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:19.343217 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8ec24ba3-1cfb-4154-a11f-dbf18762e356 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:19.343640 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-8ec24ba3-1cfb-4154-a11f-dbf18762e356 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:19.474825 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-8ec24ba3-1cfb-4154-a11f-dbf18762e356 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b2f7b56f6d94908bf00b3f21954776c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea40881648b4df393fc35c07d8f68dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:13:19.482848 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-8ec24ba3-1cfb-4154-a11f-dbf18762e356 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] 10.222.0.48 "GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57" status: 200 len: 1575 microversion: 2.1 time: 0.152284 Aug 11 11:13:19.483419 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 537/1087] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:13:19 2022] GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57 => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:13:19.928901 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-7cdf3cca-0f93-48ee-a012-297f84074747 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:13:19.929608 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-7cdf3cca-0f93-48ee-a012-297f84074747 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] [instance: e4543ff2-0618-457d-b0db-013b6b636f0c] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:13:19.936946 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7cdf3cca-0f93-48ee-a012-297f84074747 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:19.937431 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7cdf3cca-0f93-48ee-a012-297f84074747 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:19.937870 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7cdf3cca-0f93-48ee-a012-297f84074747 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:19.938563 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7cdf3cca-0f93-48ee-a012-297f84074747 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:19.939018 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7cdf3cca-0f93-48ee-a012-297f84074747 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:19.939442 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7cdf3cca-0f93-48ee-a012-297f84074747 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:20.068640 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-7cdf3cca-0f93-48ee-a012-297f84074747 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172fb1dca7c24ffdba4d10b34ba45fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84146bd4aa1425c843ad28653586d7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:13:20.076806 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-7cdf3cca-0f93-48ee-a012-297f84074747 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] 10.222.0.48 "GET /compute/v2.1/servers/e4543ff2-0618-457d-b0db-013b6b636f0c" status: 200 len: 1314 microversion: 2.1 time: 0.153762 Aug 11 11:13:20.077601 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 551/1088] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:13:19 2022] GET /compute/v2.1/servers/e4543ff2-0618-457d-b0db-013b6b636f0c => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:13:20.570498 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-4885007d-aafb-4c9a-bc1f-7faf960e8275 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:13:20.571187 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-4885007d-aafb-4c9a-bc1f-7faf960e8275 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] [instance: 9c9f7edb-2175-4575-ac11-781015e25a57] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:13:20.578246 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4885007d-aafb-4c9a-bc1f-7faf960e8275 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:20.578899 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4885007d-aafb-4c9a-bc1f-7faf960e8275 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:20.579295 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4885007d-aafb-4c9a-bc1f-7faf960e8275 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:20.580013 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4885007d-aafb-4c9a-bc1f-7faf960e8275 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:20.580466 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4885007d-aafb-4c9a-bc1f-7faf960e8275 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:20.580890 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4885007d-aafb-4c9a-bc1f-7faf960e8275 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:20.715154 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-4885007d-aafb-4c9a-bc1f-7faf960e8275 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b2f7b56f6d94908bf00b3f21954776c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea40881648b4df393fc35c07d8f68dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:13:20.722674 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-4885007d-aafb-4c9a-bc1f-7faf960e8275 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] 10.222.0.48 "GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57" status: 200 len: 1575 microversion: 2.1 time: 0.156121 Aug 11 11:13:20.723229 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 538/1089] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:13:20 2022] GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57 => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:13:21.098315 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-87628835-6e6b-4379-87c7-2269fb611449 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:13:21.098953 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-87628835-6e6b-4379-87c7-2269fb611449 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] [instance: e4543ff2-0618-457d-b0db-013b6b636f0c] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:13:21.106105 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-87628835-6e6b-4379-87c7-2269fb611449 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:21.106582 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-87628835-6e6b-4379-87c7-2269fb611449 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:21.107015 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-87628835-6e6b-4379-87c7-2269fb611449 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:21.107700 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-87628835-6e6b-4379-87c7-2269fb611449 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:21.108192 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-87628835-6e6b-4379-87c7-2269fb611449 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:21.108678 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-87628835-6e6b-4379-87c7-2269fb611449 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:21.244083 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-87628835-6e6b-4379-87c7-2269fb611449 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172fb1dca7c24ffdba4d10b34ba45fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84146bd4aa1425c843ad28653586d7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:13:21.251479 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-87628835-6e6b-4379-87c7-2269fb611449 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] 10.222.0.48 "GET /compute/v2.1/servers/e4543ff2-0618-457d-b0db-013b6b636f0c" status: 200 len: 1314 microversion: 2.1 time: 0.157034 Aug 11 11:13:21.252073 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 552/1090] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:13:21 2022] GET /compute/v2.1/servers/e4543ff2-0618-457d-b0db-013b6b636f0c => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:13:21.744061 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-d3560d4a-b43a-4c08-98c5-fa8cd7912148 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:13:21.744693 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-d3560d4a-b43a-4c08-98c5-fa8cd7912148 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] [instance: 9c9f7edb-2175-4575-ac11-781015e25a57] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:13:21.751744 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d3560d4a-b43a-4c08-98c5-fa8cd7912148 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:21.752253 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d3560d4a-b43a-4c08-98c5-fa8cd7912148 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:21.752684 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d3560d4a-b43a-4c08-98c5-fa8cd7912148 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:21.753361 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d3560d4a-b43a-4c08-98c5-fa8cd7912148 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:21.753807 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d3560d4a-b43a-4c08-98c5-fa8cd7912148 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:21.754225 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d3560d4a-b43a-4c08-98c5-fa8cd7912148 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:21.884594 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-d3560d4a-b43a-4c08-98c5-fa8cd7912148 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b2f7b56f6d94908bf00b3f21954776c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea40881648b4df393fc35c07d8f68dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:13:21.892331 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-d3560d4a-b43a-4c08-98c5-fa8cd7912148 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] 10.222.0.48 "GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57" status: 200 len: 1575 microversion: 2.1 time: 0.152179 Aug 11 11:13:21.893095 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 539/1091] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:13:21 2022] GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:13:22.272009 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-eb74c3ff-edf5-4c3d-9340-e0eb04deca84 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:13:22.272615 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-eb74c3ff-edf5-4c3d-9340-e0eb04deca84 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] [instance: e4543ff2-0618-457d-b0db-013b6b636f0c] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:13:22.279703 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-eb74c3ff-edf5-4c3d-9340-e0eb04deca84 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:22.280227 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-eb74c3ff-edf5-4c3d-9340-e0eb04deca84 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:22.281477 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-eb74c3ff-edf5-4c3d-9340-e0eb04deca84 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:22.281477 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-eb74c3ff-edf5-4c3d-9340-e0eb04deca84 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:22.282290 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-eb74c3ff-edf5-4c3d-9340-e0eb04deca84 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:22.282290 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-eb74c3ff-edf5-4c3d-9340-e0eb04deca84 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:22.414443 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-eb74c3ff-edf5-4c3d-9340-e0eb04deca84 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172fb1dca7c24ffdba4d10b34ba45fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84146bd4aa1425c843ad28653586d7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:13:22.422095 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-eb74c3ff-edf5-4c3d-9340-e0eb04deca84 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] 10.222.0.48 "GET /compute/v2.1/servers/e4543ff2-0618-457d-b0db-013b6b636f0c" status: 200 len: 1314 microversion: 2.1 time: 0.154145 Aug 11 11:13:22.422655 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 553/1092] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:13:22 2022] GET /compute/v2.1/servers/e4543ff2-0618-457d-b0db-013b6b636f0c => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:13:22.914249 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-b98bc013-62d2-42e5-93ac-ed91cf5a817e tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:13:22.914855 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-b98bc013-62d2-42e5-93ac-ed91cf5a817e tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] [instance: 9c9f7edb-2175-4575-ac11-781015e25a57] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:13:22.922152 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b98bc013-62d2-42e5-93ac-ed91cf5a817e tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:22.922658 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b98bc013-62d2-42e5-93ac-ed91cf5a817e tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:22.923089 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b98bc013-62d2-42e5-93ac-ed91cf5a817e tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:22.923785 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b98bc013-62d2-42e5-93ac-ed91cf5a817e tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:22.924270 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b98bc013-62d2-42e5-93ac-ed91cf5a817e tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:22.924702 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b98bc013-62d2-42e5-93ac-ed91cf5a817e tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:23.054359 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-b98bc013-62d2-42e5-93ac-ed91cf5a817e tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b2f7b56f6d94908bf00b3f21954776c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea40881648b4df393fc35c07d8f68dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:13:23.062630 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-b98bc013-62d2-42e5-93ac-ed91cf5a817e tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] 10.222.0.48 "GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57" status: 200 len: 1562 microversion: 2.1 time: 0.152302 Aug 11 11:13:23.063203 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 540/1093] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:13:22 2022] GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57 => generated 1562 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:13:23.442499 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-f1cc3a22-2e54-4d20-80b0-ddecd2129e9d tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:13:23.443114 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-f1cc3a22-2e54-4d20-80b0-ddecd2129e9d tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] [instance: e4543ff2-0618-457d-b0db-013b6b636f0c] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:13:23.445193 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell0:SELECT=2 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:13:23.445860 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell0:SELECT=6 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:13:23.451090 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f1cc3a22-2e54-4d20-80b0-ddecd2129e9d tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:23.451566 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f1cc3a22-2e54-4d20-80b0-ddecd2129e9d tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:23.452237 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f1cc3a22-2e54-4d20-80b0-ddecd2129e9d tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:23.453023 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f1cc3a22-2e54-4d20-80b0-ddecd2129e9d tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:23.453593 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f1cc3a22-2e54-4d20-80b0-ddecd2129e9d tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:23.454092 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f1cc3a22-2e54-4d20-80b0-ddecd2129e9d tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:23.584390 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-f1cc3a22-2e54-4d20-80b0-ddecd2129e9d tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172fb1dca7c24ffdba4d10b34ba45fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84146bd4aa1425c843ad28653586d7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:13:23.592267 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-f1cc3a22-2e54-4d20-80b0-ddecd2129e9d tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] 10.222.0.48 "GET /compute/v2.1/servers/e4543ff2-0618-457d-b0db-013b6b636f0c" status: 200 len: 1314 microversion: 2.1 time: 0.153635 Aug 11 11:13:23.593357 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 554/1094] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:13:23 2022] GET /compute/v2.1/servers/e4543ff2-0618-457d-b0db-013b6b636f0c => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:13:24.613547 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-1f2f76ad-fcaf-4297-b234-6a874bf2e09e tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:13:24.614278 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-1f2f76ad-fcaf-4297-b234-6a874bf2e09e tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] [instance: e4543ff2-0618-457d-b0db-013b6b636f0c] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:13:24.619870 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell0:SELECT=4 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:13:24.622311 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1f2f76ad-fcaf-4297-b234-6a874bf2e09e tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:24.622796 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1f2f76ad-fcaf-4297-b234-6a874bf2e09e tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:24.623223 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1f2f76ad-fcaf-4297-b234-6a874bf2e09e tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:24.623966 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1f2f76ad-fcaf-4297-b234-6a874bf2e09e tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:24.624418 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1f2f76ad-fcaf-4297-b234-6a874bf2e09e tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:24.625548 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-1f2f76ad-fcaf-4297-b234-6a874bf2e09e tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:24.756620 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-1f2f76ad-fcaf-4297-b234-6a874bf2e09e tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172fb1dca7c24ffdba4d10b34ba45fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84146bd4aa1425c843ad28653586d7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:13:24.764116 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-1f2f76ad-fcaf-4297-b234-6a874bf2e09e tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] 10.222.0.48 "GET /compute/v2.1/servers/e4543ff2-0618-457d-b0db-013b6b636f0c" status: 200 len: 1314 microversion: 2.1 time: 0.155055 Aug 11 11:13:24.764680 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 541/1095] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:13:24 2022] GET /compute/v2.1/servers/e4543ff2-0618-457d-b0db-013b6b636f0c => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:13:25.279439 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-bb51aaae-d997-45f0-bff5-fc9e54eb906f req-8553647e-22f9-47e0-9534-b6d53c182179 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4543ff2-0618-457d-b0db-013b6b636f0c", "name": "network-vif-plugged", "status": "completed", "tag": "8d958282-d0a9-499c-a269-b09d16821c64"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:13:25.290941 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-bb51aaae-d997-45f0-bff5-fc9e54eb906f req-8553647e-22f9-47e0-9534-b6d53c182179 service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:25.291411 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-bb51aaae-d997-45f0-bff5-fc9e54eb906f req-8553647e-22f9-47e0-9534-b6d53c182179 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:25.291934 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-bb51aaae-d997-45f0-bff5-fc9e54eb906f req-8553647e-22f9-47e0-9534-b6d53c182179 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:25.303434 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-bb51aaae-d997-45f0-bff5-fc9e54eb906f req-8553647e-22f9-47e0-9534-b6d53c182179 service nova] Creating event network-vif-plugged:8d958282-d0a9-499c-a269-b09d16821c64 for instance e4543ff2-0618-457d-b0db-013b6b636f0c on hv-cinder-82002 Aug 11 11:13:25.308439 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-bb51aaae-d997-45f0-bff5-fc9e54eb906f req-8553647e-22f9-47e0-9534-b6d53c182179 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033454 Aug 11 11:13:25.309012 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 555/1096] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:13:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:13:25.788246 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-a1b4bf85-a1c3-4b74-bc03-ac3d4db70476 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:13:25.788879 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-a1b4bf85-a1c3-4b74-bc03-ac3d4db70476 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] [instance: e4543ff2-0618-457d-b0db-013b6b636f0c] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:13:25.795905 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a1b4bf85-a1c3-4b74-bc03-ac3d4db70476 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:25.796391 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a1b4bf85-a1c3-4b74-bc03-ac3d4db70476 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:25.796827 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a1b4bf85-a1c3-4b74-bc03-ac3d4db70476 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:25.797579 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a1b4bf85-a1c3-4b74-bc03-ac3d4db70476 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:25.798104 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a1b4bf85-a1c3-4b74-bc03-ac3d4db70476 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:25.798537 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a1b4bf85-a1c3-4b74-bc03-ac3d4db70476 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:25.940229 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-a1b4bf85-a1c3-4b74-bc03-ac3d4db70476 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172fb1dca7c24ffdba4d10b34ba45fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84146bd4aa1425c843ad28653586d7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:13:25.947925 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-a1b4bf85-a1c3-4b74-bc03-ac3d4db70476 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] 10.222.0.48 "GET /compute/v2.1/servers/e4543ff2-0618-457d-b0db-013b6b636f0c" status: 200 len: 1314 microversion: 2.1 time: 0.163605 Aug 11 11:13:25.948512 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 542/1097] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:13:25 2022] GET /compute/v2.1/servers/e4543ff2-0618-457d-b0db-013b6b636f0c => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:13:26.968952 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-ed7294f5-9c01-4c41-a930-16f455277edc tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:13:26.969658 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-ed7294f5-9c01-4c41-a930-16f455277edc tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] [instance: e4543ff2-0618-457d-b0db-013b6b636f0c] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:13:26.976200 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ed7294f5-9c01-4c41-a930-16f455277edc tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:26.976673 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ed7294f5-9c01-4c41-a930-16f455277edc tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:26.977101 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ed7294f5-9c01-4c41-a930-16f455277edc tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:26.977783 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ed7294f5-9c01-4c41-a930-16f455277edc tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:26.978230 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ed7294f5-9c01-4c41-a930-16f455277edc tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:26.978645 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ed7294f5-9c01-4c41-a930-16f455277edc tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:27.118216 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-ed7294f5-9c01-4c41-a930-16f455277edc tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172fb1dca7c24ffdba4d10b34ba45fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84146bd4aa1425c843ad28653586d7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:13:27.126126 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-ed7294f5-9c01-4c41-a930-16f455277edc tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] 10.222.0.48 "GET /compute/v2.1/servers/e4543ff2-0618-457d-b0db-013b6b636f0c" status: 200 len: 1314 microversion: 2.1 time: 0.161366 Aug 11 11:13:27.126791 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 556/1098] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:13:26 2022] GET /compute/v2.1/servers/e4543ff2-0618-457d-b0db-013b6b636f0c => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:13:27.503747 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-ce11fbc1-2ee0-4787-b91a-68b927321784 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:13:27.504350 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-ce11fbc1-2ee0-4787-b91a-68b927321784 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: 5a7a6694-e9a6-4914-a702-51fcc95a5233] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:13:27.510840 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ce11fbc1-2ee0-4787-b91a-68b927321784 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:27.511324 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ce11fbc1-2ee0-4787-b91a-68b927321784 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:27.511790 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ce11fbc1-2ee0-4787-b91a-68b927321784 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:27.512485 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ce11fbc1-2ee0-4787-b91a-68b927321784 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:27.512996 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ce11fbc1-2ee0-4787-b91a-68b927321784 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:27.513444 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ce11fbc1-2ee0-4787-b91a-68b927321784 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:27.537731 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-ce11fbc1-2ee0-4787-b91a-68b927321784 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7a6694-e9a6-4914-a702-51fcc95a5233/ips" status: 200 len: 150 microversion: 2.1 time: 0.037952 Aug 11 11:13:27.543270 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 543/1099] 10.222.0.48 () {58 vars in 1248 bytes} [Thu Aug 11 11:13:27 2022] GET /compute/v2.1/servers/5a7a6694-e9a6-4914-a702-51fcc95a5233/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:13:28.148451 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-0416c338-2504-4363-8081-1bba06c9cfaf tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:13:28.149138 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-0416c338-2504-4363-8081-1bba06c9cfaf tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] [instance: e4543ff2-0618-457d-b0db-013b6b636f0c] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:13:28.151710 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:13:28.156758 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0416c338-2504-4363-8081-1bba06c9cfaf tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:28.157222 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0416c338-2504-4363-8081-1bba06c9cfaf tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:28.157659 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0416c338-2504-4363-8081-1bba06c9cfaf tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:28.158353 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0416c338-2504-4363-8081-1bba06c9cfaf tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:28.158806 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0416c338-2504-4363-8081-1bba06c9cfaf tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:28.159233 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0416c338-2504-4363-8081-1bba06c9cfaf tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:28.297997 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-0416c338-2504-4363-8081-1bba06c9cfaf tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172fb1dca7c24ffdba4d10b34ba45fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84146bd4aa1425c843ad28653586d7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:13:28.298484 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:13:28.304468 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-0416c338-2504-4363-8081-1bba06c9cfaf tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] 10.222.0.48 "GET /compute/v2.1/servers/e4543ff2-0618-457d-b0db-013b6b636f0c" status: 200 len: 1498 microversion: 2.1 time: 0.160614 Aug 11 11:13:28.305038 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 557/1100] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:13:28 2022] GET /compute/v2.1/servers/e4543ff2-0618-457d-b0db-013b6b636f0c => generated 1498 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:13:29.229844 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-c1489dc6-dafc-42df-befa-1062ed14512e tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e2702454-b77a-47c1-a98e-9228bed780cb"}} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:13:29.232339 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-c1489dc6-dafc-42df-befa-1062ed14512e tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: 5a7a6694-e9a6-4914-a702-51fcc95a5233] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:13:29.239008 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c1489dc6-dafc-42df-befa-1062ed14512e tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:29.239565 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c1489dc6-dafc-42df-befa-1062ed14512e tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:29.240026 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c1489dc6-dafc-42df-befa-1062ed14512e tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:29.240751 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c1489dc6-dafc-42df-befa-1062ed14512e tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:29.241208 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c1489dc6-dafc-42df-befa-1062ed14512e tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:29.241638 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c1489dc6-dafc-42df-befa-1062ed14512e tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:29.539551 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-bab1d99e-7487-41a9-a939-1b75254fb8f9 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:13:29.539551 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-bab1d99e-7487-41a9-a939-1b75254fb8f9 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] [instance: e4543ff2-0618-457d-b0db-013b6b636f0c] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:13:29.543414 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bab1d99e-7487-41a9-a939-1b75254fb8f9 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:29.543928 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bab1d99e-7487-41a9-a939-1b75254fb8f9 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:29.544365 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bab1d99e-7487-41a9-a939-1b75254fb8f9 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:29.545047 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bab1d99e-7487-41a9-a939-1b75254fb8f9 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:29.545497 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bab1d99e-7487-41a9-a939-1b75254fb8f9 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:29.546190 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bab1d99e-7487-41a9-a939-1b75254fb8f9 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:29.571368 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-bab1d99e-7487-41a9-a939-1b75254fb8f9 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] [instance: e4543ff2-0618-457d-b0db-013b6b636f0c] Going to try to terminate instance {{(pid=121232) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 11 11:13:29.919406 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-bab1d99e-7487-41a9-a939-1b75254fb8f9 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] 10.222.0.48 "DELETE /compute/v2.1/servers/e4543ff2-0618-457d-b0db-013b6b636f0c" status: 204 len: 0 microversion: 2.1 time: 0.387845 Aug 11 11:13:29.920426 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 558/1101] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Aug 11 11:13:29 2022] DELETE /compute/v2.1/servers/e4543ff2-0618-457d-b0db-013b6b636f0c => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 11 11:13:29.933745 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-5238129e-cfcf-4191-b281-a97b7d2c7b4e tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:13:29.934433 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-5238129e-cfcf-4191-b281-a97b7d2c7b4e tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] [instance: e4543ff2-0618-457d-b0db-013b6b636f0c] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:13:29.940266 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5238129e-cfcf-4191-b281-a97b7d2c7b4e tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:29.940741 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5238129e-cfcf-4191-b281-a97b7d2c7b4e tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:29.941196 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5238129e-cfcf-4191-b281-a97b7d2c7b4e tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:29.941876 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5238129e-cfcf-4191-b281-a97b7d2c7b4e tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:29.942321 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5238129e-cfcf-4191-b281-a97b7d2c7b4e tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:29.942747 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5238129e-cfcf-4191-b281-a97b7d2c7b4e tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:30.082594 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-5238129e-cfcf-4191-b281-a97b7d2c7b4e tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172fb1dca7c24ffdba4d10b34ba45fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84146bd4aa1425c843ad28653586d7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:13:30.090157 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-5238129e-cfcf-4191-b281-a97b7d2c7b4e tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] 10.222.0.48 "GET /compute/v2.1/servers/e4543ff2-0618-457d-b0db-013b6b636f0c" status: 200 len: 1504 microversion: 2.1 time: 0.161019 Aug 11 11:13:30.090735 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 559/1102] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:13:29 2022] GET /compute/v2.1/servers/e4543ff2-0618-457d-b0db-013b6b636f0c => generated 1504 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:13:30.269297 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-c1489dc6-dafc-42df-befa-1062ed14512e tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "POST /compute/v2.1/servers/5a7a6694-e9a6-4914-a702-51fcc95a5233/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.043954 Aug 11 11:13:30.275962 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 544/1103] 10.222.0.48 () {60 vars in 1323 bytes} [Thu Aug 11 11:13:29 2022] POST /compute/v2.1/servers/5a7a6694-e9a6-4914-a702-51fcc95a5233/os-volume_attachments => generated 194 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:13:31.111636 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-5a2f5539-c845-4a89-b9ce-1e81e9ccafa5 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:13:31.112289 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-5a2f5539-c845-4a89-b9ce-1e81e9ccafa5 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] [instance: e4543ff2-0618-457d-b0db-013b6b636f0c] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:13:31.119008 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5a2f5539-c845-4a89-b9ce-1e81e9ccafa5 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:31.119430 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5a2f5539-c845-4a89-b9ce-1e81e9ccafa5 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:31.119906 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5a2f5539-c845-4a89-b9ce-1e81e9ccafa5 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:31.120598 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5a2f5539-c845-4a89-b9ce-1e81e9ccafa5 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:31.121046 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5a2f5539-c845-4a89-b9ce-1e81e9ccafa5 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:31.121465 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-5a2f5539-c845-4a89-b9ce-1e81e9ccafa5 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:31.253258 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-5a2f5539-c845-4a89-b9ce-1e81e9ccafa5 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172fb1dca7c24ffdba4d10b34ba45fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84146bd4aa1425c843ad28653586d7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:13:31.261287 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-5a2f5539-c845-4a89-b9ce-1e81e9ccafa5 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] 10.222.0.48 "GET /compute/v2.1/servers/e4543ff2-0618-457d-b0db-013b6b636f0c" status: 200 len: 1504 microversion: 2.1 time: 0.153531 Aug 11 11:13:31.262060 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 560/1104] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:13:31 2022] GET /compute/v2.1/servers/e4543ff2-0618-457d-b0db-013b6b636f0c => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:13:32.215920 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-6b8f3c06-7dd2-4e6b-b58f-0fc568190191 req-092d7d9d-cef7-4293-9bd3-54e612f6ac12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4543ff2-0618-457d-b0db-013b6b636f0c", "name": "network-vif-deleted", "tag": "8d958282-d0a9-499c-a269-b09d16821c64"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:13:32.221201 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_api:SELECT=50 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:13:32.227155 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-6b8f3c06-7dd2-4e6b-b58f-0fc568190191 req-092d7d9d-cef7-4293-9bd3-54e612f6ac12 service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:32.227640 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-6b8f3c06-7dd2-4e6b-b58f-0fc568190191 req-092d7d9d-cef7-4293-9bd3-54e612f6ac12 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:32.228110 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-6b8f3c06-7dd2-4e6b-b58f-0fc568190191 req-092d7d9d-cef7-4293-9bd3-54e612f6ac12 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:32.233256 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:13:32.242445 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-6b8f3c06-7dd2-4e6b-b58f-0fc568190191 req-092d7d9d-cef7-4293-9bd3-54e612f6ac12 service nova] Creating event network-vif-deleted:8d958282-d0a9-499c-a269-b09d16821c64 for instance e4543ff2-0618-457d-b0db-013b6b636f0c on hv-cinder-82002 Aug 11 11:13:32.244570 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-6b8f3c06-7dd2-4e6b-b58f-0fc568190191 req-092d7d9d-cef7-4293-9bd3-54e612f6ac12 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033953 Aug 11 11:13:32.245136 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 545/1105] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:13:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:13:32.281772 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-38dbfbc7-e62b-4d83-ab2c-6855b6f86460 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:13:32.282386 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-38dbfbc7-e62b-4d83-ab2c-6855b6f86460 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] [instance: e4543ff2-0618-457d-b0db-013b6b636f0c] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:13:32.288746 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-38dbfbc7-e62b-4d83-ab2c-6855b6f86460 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:32.294139 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-38dbfbc7-e62b-4d83-ab2c-6855b6f86460 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:32.294139 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-38dbfbc7-e62b-4d83-ab2c-6855b6f86460 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:32.294139 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-38dbfbc7-e62b-4d83-ab2c-6855b6f86460 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:32.294139 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-38dbfbc7-e62b-4d83-ab2c-6855b6f86460 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:32.294561 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-38dbfbc7-e62b-4d83-ab2c-6855b6f86460 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:32.357349 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-38dbfbc7-e62b-4d83-ab2c-6855b6f86460 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172fb1dca7c24ffdba4d10b34ba45fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84146bd4aa1425c843ad28653586d7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:13:32.364769 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-38dbfbc7-e62b-4d83-ab2c-6855b6f86460 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] 10.222.0.48 "GET /compute/v2.1/servers/e4543ff2-0618-457d-b0db-013b6b636f0c" status: 200 len: 1462 microversion: 2.1 time: 0.087056 Aug 11 11:13:32.365343 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 561/1106] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:13:32 2022] GET /compute/v2.1/servers/e4543ff2-0618-457d-b0db-013b6b636f0c => generated 1462 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:13:33.386941 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-6cc92429-11d9-44a0-a37d-36b026792e4d tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:13:33.387559 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-6cc92429-11d9-44a0-a37d-36b026792e4d tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] [instance: e4543ff2-0618-457d-b0db-013b6b636f0c] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:13:33.394817 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6cc92429-11d9-44a0-a37d-36b026792e4d tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:33.395298 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6cc92429-11d9-44a0-a37d-36b026792e4d tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:33.395732 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6cc92429-11d9-44a0-a37d-36b026792e4d tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:33.396437 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6cc92429-11d9-44a0-a37d-36b026792e4d tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:33.396889 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6cc92429-11d9-44a0-a37d-36b026792e4d tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:33.397310 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6cc92429-11d9-44a0-a37d-36b026792e4d tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:33.428365 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6cc92429-11d9-44a0-a37d-36b026792e4d tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:33.428845 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6cc92429-11d9-44a0-a37d-36b026792e4d tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:33.429280 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6cc92429-11d9-44a0-a37d-36b026792e4d tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:33.429722 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.objects.instance [None req-6cc92429-11d9-44a0-a37d-36b026792e4d tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lazy-loading 'fault' on Instance uuid e4543ff2-0618-457d-b0db-013b6b636f0c {{(pid=121231) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 11:13:33.471739 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-6cc92429-11d9-44a0-a37d-36b026792e4d tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172fb1dca7c24ffdba4d10b34ba45fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84146bd4aa1425c843ad28653586d7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:13:33.478502 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-6cc92429-11d9-44a0-a37d-36b026792e4d tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] 10.222.0.48 "GET /compute/v2.1/servers/e4543ff2-0618-457d-b0db-013b6b636f0c" status: 200 len: 1304 microversion: 2.1 time: 0.096340 Aug 11 11:13:33.479072 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 546/1107] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:13:33 2022] GET /compute/v2.1/servers/e4543ff2-0618-457d-b0db-013b6b636f0c => generated 1304 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:13:34.507302 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-7f7b0f27-3ab0-4cef-bb28-0d59e0f97757 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:13:34.508021 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-7f7b0f27-3ab0-4cef-bb28-0d59e0f97757 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] [instance: e4543ff2-0618-457d-b0db-013b6b636f0c] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:13:34.515258 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7f7b0f27-3ab0-4cef-bb28-0d59e0f97757 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:34.515787 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7f7b0f27-3ab0-4cef-bb28-0d59e0f97757 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:34.516253 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7f7b0f27-3ab0-4cef-bb28-0d59e0f97757 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:34.516856 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7f7b0f27-3ab0-4cef-bb28-0d59e0f97757 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:34.517302 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7f7b0f27-3ab0-4cef-bb28-0d59e0f97757 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:34.517726 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7f7b0f27-3ab0-4cef-bb28-0d59e0f97757 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:34.533894 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.wsgi [None req-7f7b0f27-3ab0-4cef-bb28-0d59e0f97757 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] HTTP exception thrown: Instance e4543ff2-0618-457d-b0db-013b6b636f0c could not be found. Aug 11 11:13:34.535571 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-7f7b0f27-3ab0-4cef-bb28-0d59e0f97757 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Request method failure captured: Aug 11 11:13:34.535571 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: request: GET /compute/v2.1/servers/e4543ff2-0618-457d-b0db-013b6b636f0c HTTP/1.1 Aug 11 11:13:34.535571 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Accept: application/json Aug 11 11:13:34.535571 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Accept-Encoding: identity Aug 11 11:13:34.535571 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Connection: close Aug 11 11:13:34.535571 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Content-Length: 0 Aug 11 11:13:34.535571 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Content-Type: application/json Aug 11 11:13:34.535571 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Host: 10.222.0.48 Aug 11 11:13:34.535571 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Openstack-System-Scope: None Aug 11 11:13:34.535571 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: User-Agent: python-urllib3/1.26.11 Aug 11 11:13:34.535571 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Auth-Token: gAAAAABi9ORFYneY3q7WmJj3VO8n-l2bU2PioJMSGkY23RAw0kA9kqWryP-1SeqGprdDTaM0zE7meNsBU1s1QBeoWdlS8254bGObucSWmyXZ1eILlvhPGyHa-svV385nOcYkFn3t7NN9L4LCagpWnzBA48QdI4Kgf6C73R4mG80WcGWvk8HkmXA Aug 11 11:13:34.535571 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Domain-Id: None Aug 11 11:13:34.535571 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Domain-Name: None Aug 11 11:13:34.535571 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Identity-Status: Confirmed Aug 11 11:13:34.535571 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Is-Admin-Project: True Aug 11 11:13:34.535571 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Domain-Id: default Aug 11 11:13:34.535571 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Domain-Name: Default Aug 11 11:13:34.535571 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Id: b84146bd4aa1425c843ad28653586d7a Aug 11 11:13:34.535571 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Name: tempest-VolumesActionsTest-1717920515 Aug 11 11:13:34.535571 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Role: reader,member Aug 11 11:13:34.535571 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Roles: reader,member Aug 11 11:13:34.537101 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b84146bd4aa1425c843ad28653586d7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b84146bd4aa1425c843ad28653586d7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b84146bd4aa1425c843ad28653586d7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b84146bd4aa1425c843ad28653586d7a", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] Aug 11 11:13:34.537101 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Tenant: tempest-VolumesActionsTest-1717920515 Aug 11 11:13:34.537101 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Tenant-Id: b84146bd4aa1425c843ad28653586d7a Aug 11 11:13:34.537101 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Tenant-Name: tempest-VolumesActionsTest-1717920515 Aug 11 11:13:34.537101 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User: tempest-VolumesActionsTest-1717920515-project Aug 11 11:13:34.537101 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Domain-Id: default Aug 11 11:13:34.537101 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Domain-Name: Default Aug 11 11:13:34.537101 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Id: 172fb1dca7c24ffdba4d10b34ba45fe5 Aug 11 11:13:34.537101 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Name: tempest-VolumesActionsTest-1717920515-project Aug 11 11:13:34.537101 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: method: > Aug 11 11:13:34.537101 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: exception: Instance e4543ff2-0618-457d-b0db-013b6b636f0c could not be found. Aug 11 11:13:34.537101 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: action_args: {'id': 'e4543ff2-0618-457d-b0db-013b6b636f0c'} Aug 11 11:13:34.538165 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 11:13:34.538165 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:13:34.538165 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 11:13:34.538165 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 11:13:34.538165 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 11:13:34.538165 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 11:13:34.538165 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 11:13:34.538165 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 11:13:34.538165 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 11:13:34.538165 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 11:13:34.538165 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4543ff2-0618-457d-b0db-013b6b636f0c could not be found. Aug 11 11:13:34.538165 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:13:34.538165 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:13:34.538165 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:13:34.538165 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:13:34.538165 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:13:34.538165 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:13:34.538165 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 11:13:34.538165 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 11:13:34.538165 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 11:13:34.539566 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 11:13:34.539566 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 11:13:34.539566 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 11:13:34.539566 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 11:13:34.539566 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 11:13:34.539566 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 11:13:34.539566 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 11:13:34.539566 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4543ff2-0618-457d-b0db-013b6b636f0c could not be found. Aug 11 11:13:34.539566 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:13:34.539566 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:13:34.539566 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:13:34.539566 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:13:34.539566 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:13:34.539566 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:13:34.539566 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 11:13:34.539566 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 11:13:34.539566 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4543ff2-0618-457d-b0db-013b6b636f0c could not be found. Aug 11 11:13:34.539566 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:13:34.541828 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-7f7b0f27-3ab0-4cef-bb28-0d59e0f97757 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Returning 404 to user: Instance e4543ff2-0618-457d-b0db-013b6b636f0c could not be found. {{(pid=121232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 11:13:34.541828 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-7f7b0f27-3ab0-4cef-bb28-0d59e0f97757 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] 10.222.0.48 "GET /compute/v2.1/servers/e4543ff2-0618-457d-b0db-013b6b636f0c" status: 404 len: 111 microversion: 2.1 time: 0.033783 Aug 11 11:13:34.541828 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 562/1108] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:13:34 2022] GET /compute/v2.1/servers/e4543ff2-0618-457d-b0db-013b6b636f0c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 11:13:34.652671 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-dc22db32-c07a-4245-9bd3-7af20f86330d tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-558779738", "imageRef": "05993162-aafd-4f1d-b781-ec09593713e5", "flavorRef": "452", "networks": [{"uuid": "887e1af0-fd80-4efb-9d61-69a5bed3e530"}]}} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:13:34.715355 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.network.neutron [None req-dc22db32-c07a-4245-9bd3-7af20f86330d tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] validate_networks() for [('887e1af0-fd80-4efb-9d61-69a5bed3e530', None, None, None, None, None)] {{(pid=121231) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 11 11:13:35.092809 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-dc22db32-c07a-4245-9bd3-7af20f86330d tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Flavor limits 0:0:0 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 11 11:13:35.093230 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-dc22db32-c07a-4245-9bd3-7af20f86330d tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Image limits 0:0:0 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 11 11:13:35.093729 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-dc22db32-c07a-4245-9bd3-7af20f86330d tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Flavor pref 0:0:0 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 11 11:13:35.094138 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-dc22db32-c07a-4245-9bd3-7af20f86330d tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Image pref 0:0:0 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 11 11:13:35.094576 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-dc22db32-c07a-4245-9bd3-7af20f86330d tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 11 11:13:35.103228 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-dc22db32-c07a-4245-9bd3-7af20f86330d tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:35.103707 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-dc22db32-c07a-4245-9bd3-7af20f86330d tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:35.104173 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-dc22db32-c07a-4245-9bd3-7af20f86330d tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:35.104893 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-dc22db32-c07a-4245-9bd3-7af20f86330d tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:35.105342 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-dc22db32-c07a-4245-9bd3-7af20f86330d tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:35.105765 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-dc22db32-c07a-4245-9bd3-7af20f86330d tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:35.123530 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.quota [None req-dc22db32-c07a-4245-9bd3-7af20f86330d tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Getting quotas for project b84146bd4aa1425c843ad28653586d7a. Resources: {'ram', 'cores', 'instances'} {{(pid=121231) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 11:13:35.127526 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.quota [None req-dc22db32-c07a-4245-9bd3-7af20f86330d tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Getting quotas for user 172fb1dca7c24ffdba4d10b34ba45fe5 and project b84146bd4aa1425c843ad28653586d7a. Resources: {'ram', 'cores', 'instances'} {{(pid=121231) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 11:13:35.138718 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-dc22db32-c07a-4245-9bd3-7af20f86330d tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Going to run 1 instances... {{(pid=121231) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 11 11:13:35.141003 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-dc22db32-c07a-4245-9bd3-7af20f86330d tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] [instance: f47e787d-a1f9-446c-bb14-a1ad28f80217] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='05993162-aafd-4f1d-b781-ec09593713e5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121231) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 11 11:13:35.308589 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-dc22db32-c07a-4245-9bd3-7af20f86330d tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.661166 Aug 11 11:13:35.308847 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 547/1109] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Aug 11 11:13:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 663 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 11 11:13:35.321514 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-bd9eeb9f-565a-4378-9bc3-d498b174946d tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:13:35.322122 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-bd9eeb9f-565a-4378-9bc3-d498b174946d tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] [instance: f47e787d-a1f9-446c-bb14-a1ad28f80217] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:13:35.375738 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-bd9eeb9f-565a-4378-9bc3-d498b174946d tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172fb1dca7c24ffdba4d10b34ba45fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84146bd4aa1425c843ad28653586d7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:13:35.383406 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-bd9eeb9f-565a-4378-9bc3-d498b174946d tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] 10.222.0.48 "GET /compute/v2.1/servers/f47e787d-a1f9-446c-bb14-a1ad28f80217" status: 200 len: 1213 microversion: 2.1 time: 0.067644 Aug 11 11:13:35.383999 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 563/1110] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:13:35 2022] GET /compute/v2.1/servers/f47e787d-a1f9-446c-bb14-a1ad28f80217 => generated 1213 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:13:36.404764 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-ac2f605b-2154-4ef7-8088-172defc40d58 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:13:36.405474 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-ac2f605b-2154-4ef7-8088-172defc40d58 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] [instance: f47e787d-a1f9-446c-bb14-a1ad28f80217] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:13:36.411538 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ac2f605b-2154-4ef7-8088-172defc40d58 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:36.421024 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ac2f605b-2154-4ef7-8088-172defc40d58 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:36.421024 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ac2f605b-2154-4ef7-8088-172defc40d58 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:36.421024 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ac2f605b-2154-4ef7-8088-172defc40d58 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:36.421024 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ac2f605b-2154-4ef7-8088-172defc40d58 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:36.421392 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ac2f605b-2154-4ef7-8088-172defc40d58 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:36.475107 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-ac2f605b-2154-4ef7-8088-172defc40d58 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172fb1dca7c24ffdba4d10b34ba45fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84146bd4aa1425c843ad28653586d7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:13:36.483252 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-ac2f605b-2154-4ef7-8088-172defc40d58 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] 10.222.0.48 "GET /compute/v2.1/servers/f47e787d-a1f9-446c-bb14-a1ad28f80217" status: 200 len: 1217 microversion: 2.1 time: 0.082790 Aug 11 11:13:36.483771 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 548/1111] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:13:36 2022] GET /compute/v2.1/servers/f47e787d-a1f9-446c-bb14-a1ad28f80217 => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:13:37.504173 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-91e665e1-342e-4d41-9502-a4085db228a9 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:13:37.504782 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-91e665e1-342e-4d41-9502-a4085db228a9 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] [instance: f47e787d-a1f9-446c-bb14-a1ad28f80217] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:13:37.512382 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-91e665e1-342e-4d41-9502-a4085db228a9 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:37.513087 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-91e665e1-342e-4d41-9502-a4085db228a9 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:37.513524 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-91e665e1-342e-4d41-9502-a4085db228a9 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:37.514902 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-91e665e1-342e-4d41-9502-a4085db228a9 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:37.515357 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-91e665e1-342e-4d41-9502-a4085db228a9 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:37.515801 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-91e665e1-342e-4d41-9502-a4085db228a9 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:37.803966 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-91e665e1-342e-4d41-9502-a4085db228a9 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172fb1dca7c24ffdba4d10b34ba45fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84146bd4aa1425c843ad28653586d7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:13:37.812084 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-91e665e1-342e-4d41-9502-a4085db228a9 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] 10.222.0.48 "GET /compute/v2.1/servers/f47e787d-a1f9-446c-bb14-a1ad28f80217" status: 200 len: 1273 microversion: 2.1 time: 0.311763 Aug 11 11:13:37.812652 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 564/1112] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:13:37 2022] GET /compute/v2.1/servers/f47e787d-a1f9-446c-bb14-a1ad28f80217 => generated 1273 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:13:38.833799 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-f09fdcf5-b1ac-40c2-a821-2f3e9cd9e0e1 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:13:38.834466 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-f09fdcf5-b1ac-40c2-a821-2f3e9cd9e0e1 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] [instance: f47e787d-a1f9-446c-bb14-a1ad28f80217] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:13:38.841637 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f09fdcf5-b1ac-40c2-a821-2f3e9cd9e0e1 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:38.842228 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f09fdcf5-b1ac-40c2-a821-2f3e9cd9e0e1 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:38.842846 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f09fdcf5-b1ac-40c2-a821-2f3e9cd9e0e1 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:38.844386 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f09fdcf5-b1ac-40c2-a821-2f3e9cd9e0e1 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:38.844895 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f09fdcf5-b1ac-40c2-a821-2f3e9cd9e0e1 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:38.845323 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f09fdcf5-b1ac-40c2-a821-2f3e9cd9e0e1 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:39.303995 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-f09fdcf5-b1ac-40c2-a821-2f3e9cd9e0e1 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172fb1dca7c24ffdba4d10b34ba45fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84146bd4aa1425c843ad28653586d7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:13:39.312644 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-f09fdcf5-b1ac-40c2-a821-2f3e9cd9e0e1 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] 10.222.0.48 "GET /compute/v2.1/servers/f47e787d-a1f9-446c-bb14-a1ad28f80217" status: 200 len: 1313 microversion: 2.1 time: 0.482475 Aug 11 11:13:39.313330 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 549/1113] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:13:38 2022] GET /compute/v2.1/servers/f47e787d-a1f9-446c-bb14-a1ad28f80217 => generated 1313 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:13:39.786306 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-76193418-b725-41fa-9386-aa64566254e8 req-8462c7de-5734-4bb3-bff9-0b5c4a5baa20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f47e787d-a1f9-446c-bb14-a1ad28f80217", "tag": "3c2d47ce-29ed-4283-aac9-710d2b41e65f"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:13:39.797684 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-76193418-b725-41fa-9386-aa64566254e8 req-8462c7de-5734-4bb3-bff9-0b5c4a5baa20 service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:39.798309 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-76193418-b725-41fa-9386-aa64566254e8 req-8462c7de-5734-4bb3-bff9-0b5c4a5baa20 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:39.798747 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-76193418-b725-41fa-9386-aa64566254e8 req-8462c7de-5734-4bb3-bff9-0b5c4a5baa20 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:39.810900 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-76193418-b725-41fa-9386-aa64566254e8 req-8462c7de-5734-4bb3-bff9-0b5c4a5baa20 service nova] Creating event network-changed:3c2d47ce-29ed-4283-aac9-710d2b41e65f for instance f47e787d-a1f9-446c-bb14-a1ad28f80217 on hv-cinder-82002 Aug 11 11:13:39.816215 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-76193418-b725-41fa-9386-aa64566254e8 req-8462c7de-5734-4bb3-bff9-0b5c4a5baa20 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033751 Aug 11 11:13:39.817044 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 565/1114] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:13:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 11:13:39.922467 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-13c7a8d0-68ad-43dd-9a3f-8ddeeac065d8 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e2702454-b77a-47c1-a98e-9228bed780cb"}} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:13:39.924898 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-13c7a8d0-68ad-43dd-9a3f-8ddeeac065d8 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: 5a7a6694-e9a6-4914-a702-51fcc95a5233] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:13:39.931814 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-13c7a8d0-68ad-43dd-9a3f-8ddeeac065d8 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:39.932584 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-13c7a8d0-68ad-43dd-9a3f-8ddeeac065d8 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:39.933024 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-13c7a8d0-68ad-43dd-9a3f-8ddeeac065d8 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:39.933705 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-13c7a8d0-68ad-43dd-9a3f-8ddeeac065d8 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:39.934304 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-13c7a8d0-68ad-43dd-9a3f-8ddeeac065d8 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:39.934711 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-13c7a8d0-68ad-43dd-9a3f-8ddeeac065d8 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:40.015274 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.wsgi [None req-13c7a8d0-68ad-43dd-9a3f-8ddeeac065d8 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] HTTP exception thrown: Invalid volume: volume e2702454-b77a-47c1-a98e-9228bed780cb is already attached to instances: 5a7a6694-e9a6-4914-a702-51fcc95a5233 Aug 11 11:13:40.017578 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-13c7a8d0-68ad-43dd-9a3f-8ddeeac065d8 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Request method failure captured: Aug 11 11:13:40.017578 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: request: POST /compute/v2.1/servers/5a7a6694-e9a6-4914-a702-51fcc95a5233/os-volume_attachments HTTP/1.1 Aug 11 11:13:40.017578 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Accept: application/json Aug 11 11:13:40.017578 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Accept-Encoding: identity Aug 11 11:13:40.017578 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Connection: close Aug 11 11:13:40.017578 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Content-Length: 74 Aug 11 11:13:40.017578 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Content-Type: application/json Aug 11 11:13:40.017578 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Host: 10.222.0.48 Aug 11 11:13:40.017578 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Openstack-System-Scope: None Aug 11 11:13:40.017578 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: User-Agent: python-urllib3/1.26.11 Aug 11 11:13:40.017578 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Auth-Token: gAAAAABi9ONxPYWpRmadpANSM5f1tl1wVESW1SFE62fiY511YI9uU6D_79r-yuQvgjKjvFqPWeHAiFZFw3kYac2M1zqDX4QPozx6rX_pgfB-Fgz47x90y_mKI7zGyyPs8EkLoYDiomkPvd5a4fE5iPsTlEJ3RRgCL7XDnuCGisjN8PsW1aCU_y4 Aug 11 11:13:40.017578 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Domain-Id: None Aug 11 11:13:40.017578 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Domain-Name: None Aug 11 11:13:40.017578 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Identity-Status: Confirmed Aug 11 11:13:40.017578 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Is-Admin-Project: True Aug 11 11:13:40.017578 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Domain-Id: default Aug 11 11:13:40.017578 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Domain-Name: Default Aug 11 11:13:40.017578 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Id: c56bd2a662e34a6395117027b5c28c5b Aug 11 11:13:40.017578 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Name: tempest-AttachVolumeNegativeTest-848160622 Aug 11 11:13:40.017578 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Role: reader,member Aug 11 11:13:40.017578 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Roles: reader,member Aug 11 11:13:40.019010 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c56bd2a662e34a6395117027b5c28c5b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c56bd2a662e34a6395117027b5c28c5b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c56bd2a662e34a6395117027b5c28c5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c56bd2a662e34a6395117027b5c28c5b", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] Aug 11 11:13:40.019010 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant: tempest-AttachVolumeNegativeTest-848160622 Aug 11 11:13:40.019010 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant-Id: c56bd2a662e34a6395117027b5c28c5b Aug 11 11:13:40.019010 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-848160622 Aug 11 11:13:40.019010 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User: tempest-AttachVolumeNegativeTest-848160622-project Aug 11 11:13:40.019010 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Domain-Id: default Aug 11 11:13:40.019010 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Domain-Name: Default Aug 11 11:13:40.019010 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Id: 08d81bcd5a4f43ce8b4839ee15cb163b Aug 11 11:13:40.019010 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Name: tempest-AttachVolumeNegativeTest-848160622-project Aug 11 11:13:40.019010 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Aug 11 11:13:40.019010 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: {"volumeAttachment": {"volumeId": "e2702454-b77a-47c1-a98e-9228bed780cb"}} Aug 11 11:13:40.019010 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: method: > Aug 11 11:13:40.020022 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: exception: Invalid volume: volume e2702454-b77a-47c1-a98e-9228bed780cb is already attached to instances: 5a7a6694-e9a6-4914-a702-51fcc95a5233 Aug 11 11:13:40.020022 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: action_args: {'server_id': '5a7a6694-e9a6-4914-a702-51fcc95a5233', 'body': {'volumeAttachment': {'volumeId': 'e2702454-b77a-47c1-a98e-9228bed780cb'}}} Aug 11 11:13:40.020022 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 11:13:40.020022 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:13:40.020022 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 11 11:13:40.020022 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 11 11:13:40.020022 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 11 11:13:40.020022 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 11 11:13:40.020022 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 11 11:13:40.020022 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 11 11:13:40.020022 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5079, in attach_volume Aug 11 11:13:40.020022 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 11 11:13:40.020022 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4919, in _check_volume_already_attached Aug 11 11:13:40.020022 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 11 11:13:40.020022 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume e2702454-b77a-47c1-a98e-9228bed780cb is already attached to instances: 5a7a6694-e9a6-4914-a702-51fcc95a5233 Aug 11 11:13:40.020022 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:13:40.020022 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:13:40.020022 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:13:40.020022 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:13:40.021455 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:13:40.021455 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:13:40.021455 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 11:13:40.021455 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 11:13:40.021455 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 11:13:40.021455 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 11:13:40.021455 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 11 11:13:40.021455 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 11 11:13:40.021455 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 11 11:13:40.021455 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 11 11:13:40.021455 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 11 11:13:40.021455 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 11 11:13:40.021455 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 11 11:13:40.021455 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 11 11:13:40.021455 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume e2702454-b77a-47c1-a98e-9228bed780cb is already attached to instances: 5a7a6694-e9a6-4914-a702-51fcc95a5233 Aug 11 11:13:40.021455 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:13:40.021455 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:13:40.021455 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:13:40.021455 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:13:40.021455 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:13:40.022994 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:13:40.022994 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 11:13:40.022994 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 11:13:40.022994 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume e2702454-b77a-47c1-a98e-9228bed780cb is already attached to instances: 5a7a6694-e9a6-4914-a702-51fcc95a5233 Aug 11 11:13:40.022994 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:13:40.022994 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-13c7a8d0-68ad-43dd-9a3f-8ddeeac065d8 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Returning 400 to user: Invalid volume: volume e2702454-b77a-47c1-a98e-9228bed780cb is already attached to instances: 5a7a6694-e9a6-4914-a702-51fcc95a5233 {{(pid=121231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 11:13:40.022994 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-13c7a8d0-68ad-43dd-9a3f-8ddeeac065d8 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "POST /compute/v2.1/servers/5a7a6694-e9a6-4914-a702-51fcc95a5233/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.101455 Aug 11 11:13:40.022994 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 550/1115] 10.222.0.48 () {60 vars in 1323 bytes} [Thu Aug 11 11:13:39 2022] POST /compute/v2.1/servers/5a7a6694-e9a6-4914-a702-51fcc95a5233/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 11 11:13:40.087884 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-3e345c5f-6ccf-429a-ba9e-71748ee551fe tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:13:40.088488 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-3e345c5f-6ccf-429a-ba9e-71748ee551fe tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: 5a7a6694-e9a6-4914-a702-51fcc95a5233] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:13:40.095345 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3e345c5f-6ccf-429a-ba9e-71748ee551fe tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:40.100801 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3e345c5f-6ccf-429a-ba9e-71748ee551fe tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:40.100801 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3e345c5f-6ccf-429a-ba9e-71748ee551fe tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:40.100801 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3e345c5f-6ccf-429a-ba9e-71748ee551fe tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:40.100801 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3e345c5f-6ccf-429a-ba9e-71748ee551fe tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:40.101188 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3e345c5f-6ccf-429a-ba9e-71748ee551fe tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:40.187199 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.objects.instance [None req-3e345c5f-6ccf-429a-ba9e-71748ee551fe tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lazy-loading 'services' on Instance uuid 5a7a6694-e9a6-4914-a702-51fcc95a5233 {{(pid=121232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 11:13:40.333256 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-58472ff1-13b7-400d-9d1b-48bb324da137 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:13:40.333861 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-58472ff1-13b7-400d-9d1b-48bb324da137 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] [instance: f47e787d-a1f9-446c-bb14-a1ad28f80217] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:13:40.339903 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-58472ff1-13b7-400d-9d1b-48bb324da137 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:40.346990 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-58472ff1-13b7-400d-9d1b-48bb324da137 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:40.346990 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-58472ff1-13b7-400d-9d1b-48bb324da137 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:40.346990 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-58472ff1-13b7-400d-9d1b-48bb324da137 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:40.346990 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-58472ff1-13b7-400d-9d1b-48bb324da137 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:40.347406 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-58472ff1-13b7-400d-9d1b-48bb324da137 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:40.495855 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-3e345c5f-6ccf-429a-ba9e-71748ee551fe tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "DELETE /compute/v2.1/servers/5a7a6694-e9a6-4914-a702-51fcc95a5233/os-volume_attachments/e2702454-b77a-47c1-a98e-9228bed780cb" status: 202 len: 0 microversion: 2.1 time: 0.412053 Aug 11 11:13:40.499974 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 566/1116] 10.222.0.48 () {58 vars in 1416 bytes} [Thu Aug 11 11:13:40 2022] DELETE /compute/v2.1/servers/5a7a6694-e9a6-4914-a702-51fcc95a5233/os-volume_attachments/e2702454-b77a-47c1-a98e-9228bed780cb => generated 0 bytes in 414 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 11:13:40.506011 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-2bcbc89b-4df2-4eef-88f4-dfb14b825b23 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:13:40.508376 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-2bcbc89b-4df2-4eef-88f4-dfb14b825b23 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: 5a7a6694-e9a6-4914-a702-51fcc95a5233] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:13:40.514961 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2bcbc89b-4df2-4eef-88f4-dfb14b825b23 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:40.515845 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2bcbc89b-4df2-4eef-88f4-dfb14b825b23 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:40.516674 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2bcbc89b-4df2-4eef-88f4-dfb14b825b23 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:40.517235 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2bcbc89b-4df2-4eef-88f4-dfb14b825b23 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:40.518011 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2bcbc89b-4df2-4eef-88f4-dfb14b825b23 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:40.518150 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2bcbc89b-4df2-4eef-88f4-dfb14b825b23 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:40.547082 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-2bcbc89b-4df2-4eef-88f4-dfb14b825b23 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7a6694-e9a6-4914-a702-51fcc95a5233/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045138 Aug 11 11:13:40.547854 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 567/1117] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Aug 11 11:13:40 2022] GET /compute/v2.1/servers/5a7a6694-e9a6-4914-a702-51fcc95a5233/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 11:13:40.569320 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-58472ff1-13b7-400d-9d1b-48bb324da137 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172fb1dca7c24ffdba4d10b34ba45fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84146bd4aa1425c843ad28653586d7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:13:40.577703 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-58472ff1-13b7-400d-9d1b-48bb324da137 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] 10.222.0.48 "GET /compute/v2.1/servers/f47e787d-a1f9-446c-bb14-a1ad28f80217" status: 200 len: 1313 microversion: 2.1 time: 0.248358 Aug 11 11:13:40.579083 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 551/1118] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:13:40 2022] GET /compute/v2.1/servers/f47e787d-a1f9-446c-bb14-a1ad28f80217 => generated 1313 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:13:41.559813 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-e9afc105-8145-46e8-94b6-a99ae0f0c534 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:13:41.562009 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-e9afc105-8145-46e8-94b6-a99ae0f0c534 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: 5a7a6694-e9a6-4914-a702-51fcc95a5233] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:13:41.568448 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e9afc105-8145-46e8-94b6-a99ae0f0c534 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:41.568930 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e9afc105-8145-46e8-94b6-a99ae0f0c534 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:41.569369 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e9afc105-8145-46e8-94b6-a99ae0f0c534 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:41.570061 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e9afc105-8145-46e8-94b6-a99ae0f0c534 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:41.570516 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e9afc105-8145-46e8-94b6-a99ae0f0c534 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:41.570944 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e9afc105-8145-46e8-94b6-a99ae0f0c534 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:41.599021 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-0d0e0cba-f901-4adb-b36f-2d5ff322f2dd tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:13:41.599663 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-0d0e0cba-f901-4adb-b36f-2d5ff322f2dd tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] [instance: f47e787d-a1f9-446c-bb14-a1ad28f80217] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:13:41.601913 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-e9afc105-8145-46e8-94b6-a99ae0f0c534 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7a6694-e9a6-4914-a702-51fcc95a5233/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046008 Aug 11 11:13:41.602907 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 568/1119] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Aug 11 11:13:41 2022] GET /compute/v2.1/servers/5a7a6694-e9a6-4914-a702-51fcc95a5233/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:13:41.606629 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0d0e0cba-f901-4adb-b36f-2d5ff322f2dd tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:41.607123 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0d0e0cba-f901-4adb-b36f-2d5ff322f2dd tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:41.607561 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0d0e0cba-f901-4adb-b36f-2d5ff322f2dd tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:41.608293 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0d0e0cba-f901-4adb-b36f-2d5ff322f2dd tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:41.608752 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0d0e0cba-f901-4adb-b36f-2d5ff322f2dd tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:41.609184 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-0d0e0cba-f901-4adb-b36f-2d5ff322f2dd tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:41.736893 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-0d0e0cba-f901-4adb-b36f-2d5ff322f2dd tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172fb1dca7c24ffdba4d10b34ba45fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84146bd4aa1425c843ad28653586d7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:13:41.744368 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-0d0e0cba-f901-4adb-b36f-2d5ff322f2dd tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] 10.222.0.48 "GET /compute/v2.1/servers/f47e787d-a1f9-446c-bb14-a1ad28f80217" status: 200 len: 1313 microversion: 2.1 time: 0.149860 Aug 11 11:13:41.744934 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 552/1120] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:13:41 2022] GET /compute/v2.1/servers/f47e787d-a1f9-446c-bb14-a1ad28f80217 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:13:42.614165 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-7a370ee7-0c55-4516-bb8c-f83478e0ca13 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:13:42.616346 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-7a370ee7-0c55-4516-bb8c-f83478e0ca13 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: 5a7a6694-e9a6-4914-a702-51fcc95a5233] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:13:42.622804 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7a370ee7-0c55-4516-bb8c-f83478e0ca13 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:42.623283 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7a370ee7-0c55-4516-bb8c-f83478e0ca13 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:42.623721 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7a370ee7-0c55-4516-bb8c-f83478e0ca13 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:42.624425 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7a370ee7-0c55-4516-bb8c-f83478e0ca13 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:42.624878 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7a370ee7-0c55-4516-bb8c-f83478e0ca13 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:42.625299 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7a370ee7-0c55-4516-bb8c-f83478e0ca13 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:42.656523 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-7a370ee7-0c55-4516-bb8c-f83478e0ca13 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7a6694-e9a6-4914-a702-51fcc95a5233/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046772 Aug 11 11:13:42.657090 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 569/1121] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Aug 11 11:13:42 2022] GET /compute/v2.1/servers/5a7a6694-e9a6-4914-a702-51fcc95a5233/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:13:42.764274 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-cbab0b82-5823-4a02-a8d3-30a186f0a346 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:13:42.764870 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-cbab0b82-5823-4a02-a8d3-30a186f0a346 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] [instance: f47e787d-a1f9-446c-bb14-a1ad28f80217] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:13:42.771257 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-cbab0b82-5823-4a02-a8d3-30a186f0a346 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:42.771738 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-cbab0b82-5823-4a02-a8d3-30a186f0a346 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:42.772209 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-cbab0b82-5823-4a02-a8d3-30a186f0a346 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:42.772896 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-cbab0b82-5823-4a02-a8d3-30a186f0a346 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:42.773350 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-cbab0b82-5823-4a02-a8d3-30a186f0a346 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:42.773769 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-cbab0b82-5823-4a02-a8d3-30a186f0a346 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:42.906964 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-cbab0b82-5823-4a02-a8d3-30a186f0a346 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172fb1dca7c24ffdba4d10b34ba45fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84146bd4aa1425c843ad28653586d7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:13:42.914488 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-cbab0b82-5823-4a02-a8d3-30a186f0a346 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] 10.222.0.48 "GET /compute/v2.1/servers/f47e787d-a1f9-446c-bb14-a1ad28f80217" status: 200 len: 1313 microversion: 2.1 time: 0.154081 Aug 11 11:13:42.915048 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 553/1122] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:13:42 2022] GET /compute/v2.1/servers/f47e787d-a1f9-446c-bb14-a1ad28f80217 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:13:43.671163 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-6075e5f6-a264-42e6-b9c6-e26791c2ad6d tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:13:43.673484 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-6075e5f6-a264-42e6-b9c6-e26791c2ad6d tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: 5a7a6694-e9a6-4914-a702-51fcc95a5233] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:13:43.680006 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6075e5f6-a264-42e6-b9c6-e26791c2ad6d tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:43.680481 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6075e5f6-a264-42e6-b9c6-e26791c2ad6d tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:43.681182 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6075e5f6-a264-42e6-b9c6-e26791c2ad6d tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:43.681865 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6075e5f6-a264-42e6-b9c6-e26791c2ad6d tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:43.682315 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6075e5f6-a264-42e6-b9c6-e26791c2ad6d tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:43.682741 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6075e5f6-a264-42e6-b9c6-e26791c2ad6d tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:43.711235 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-6075e5f6-a264-42e6-b9c6-e26791c2ad6d tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7a6694-e9a6-4914-a702-51fcc95a5233/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044027 Aug 11 11:13:43.711719 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 570/1123] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Aug 11 11:13:43 2022] GET /compute/v2.1/servers/5a7a6694-e9a6-4914-a702-51fcc95a5233/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 11 11:13:43.771165 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-e964d6a9-c455-498b-be2b-ea53f3d82f7b tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:13:43.771711 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-e964d6a9-c455-498b-be2b-ea53f3d82f7b tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: 5a7a6694-e9a6-4914-a702-51fcc95a5233] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:13:43.778003 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e964d6a9-c455-498b-be2b-ea53f3d82f7b tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:43.778487 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e964d6a9-c455-498b-be2b-ea53f3d82f7b tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:43.778922 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e964d6a9-c455-498b-be2b-ea53f3d82f7b tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:43.779608 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e964d6a9-c455-498b-be2b-ea53f3d82f7b tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:43.780093 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e964d6a9-c455-498b-be2b-ea53f3d82f7b tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:43.780517 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e964d6a9-c455-498b-be2b-ea53f3d82f7b tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:43.809046 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-e964d6a9-c455-498b-be2b-ea53f3d82f7b tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: 5a7a6694-e9a6-4914-a702-51fcc95a5233] Going to try to terminate instance {{(pid=121231) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 11 11:13:43.936132 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-08b38753-e1cf-4d4e-acb1-32e9c9744d5f tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:13:43.937193 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-08b38753-e1cf-4d4e-acb1-32e9c9744d5f tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] [instance: f47e787d-a1f9-446c-bb14-a1ad28f80217] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:13:43.943218 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-08b38753-e1cf-4d4e-acb1-32e9c9744d5f tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:43.943708 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-08b38753-e1cf-4d4e-acb1-32e9c9744d5f tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:43.944191 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-08b38753-e1cf-4d4e-acb1-32e9c9744d5f tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:43.944884 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-08b38753-e1cf-4d4e-acb1-32e9c9744d5f tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:43.945336 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-08b38753-e1cf-4d4e-acb1-32e9c9744d5f tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:43.945770 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-08b38753-e1cf-4d4e-acb1-32e9c9744d5f tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:44.078871 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-08b38753-e1cf-4d4e-acb1-32e9c9744d5f tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172fb1dca7c24ffdba4d10b34ba45fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84146bd4aa1425c843ad28653586d7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:13:44.087163 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-08b38753-e1cf-4d4e-acb1-32e9c9744d5f tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] 10.222.0.48 "GET /compute/v2.1/servers/f47e787d-a1f9-446c-bb14-a1ad28f80217" status: 200 len: 1313 microversion: 2.1 time: 0.154955 Aug 11 11:13:44.087730 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 571/1124] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:13:43 2022] GET /compute/v2.1/servers/f47e787d-a1f9-446c-bb14-a1ad28f80217 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:13:44.196007 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-e964d6a9-c455-498b-be2b-ea53f3d82f7b tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "DELETE /compute/v2.1/servers/5a7a6694-e9a6-4914-a702-51fcc95a5233" status: 204 len: 0 microversion: 2.1 time: 0.429140 Aug 11 11:13:44.196597 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 554/1125] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Aug 11 11:13:43 2022] DELETE /compute/v2.1/servers/5a7a6694-e9a6-4914-a702-51fcc95a5233 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 11 11:13:44.204655 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-7d99aff0-11ab-4a73-9d49-43873f3a62fd tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:13:44.205288 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-7d99aff0-11ab-4a73-9d49-43873f3a62fd tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: 5a7a6694-e9a6-4914-a702-51fcc95a5233] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:13:44.211184 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7d99aff0-11ab-4a73-9d49-43873f3a62fd tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:44.211666 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7d99aff0-11ab-4a73-9d49-43873f3a62fd tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:44.212141 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7d99aff0-11ab-4a73-9d49-43873f3a62fd tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:44.212828 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7d99aff0-11ab-4a73-9d49-43873f3a62fd tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:44.213278 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7d99aff0-11ab-4a73-9d49-43873f3a62fd tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:44.213700 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7d99aff0-11ab-4a73-9d49-43873f3a62fd tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:44.341842 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-7d99aff0-11ab-4a73-9d49-43873f3a62fd tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08d81bcd5a4f43ce8b4839ee15cb163b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56bd2a662e34a6395117027b5c28c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:13:44.349253 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-7d99aff0-11ab-4a73-9d49-43873f3a62fd tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7a6694-e9a6-4914-a702-51fcc95a5233" status: 200 len: 1680 microversion: 2.1 time: 0.148431 Aug 11 11:13:44.349820 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 572/1126] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:13:44 2022] GET /compute/v2.1/servers/5a7a6694-e9a6-4914-a702-51fcc95a5233 => generated 1680 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:13:45.109632 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-ae05eeae-ce14-4a40-b763-17c8d972c94b tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:13:45.110284 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-ae05eeae-ce14-4a40-b763-17c8d972c94b tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] [instance: f47e787d-a1f9-446c-bb14-a1ad28f80217] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:13:45.113789 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell0:SELECT=2 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:13:45.117267 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ae05eeae-ce14-4a40-b763-17c8d972c94b tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:45.117749 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ae05eeae-ce14-4a40-b763-17c8d972c94b tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:45.118184 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ae05eeae-ce14-4a40-b763-17c8d972c94b tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:45.118871 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ae05eeae-ce14-4a40-b763-17c8d972c94b tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:45.119323 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ae05eeae-ce14-4a40-b763-17c8d972c94b tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:45.119744 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ae05eeae-ce14-4a40-b763-17c8d972c94b tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:45.135153 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell0:SELECT=6 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:13:45.270168 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-ae05eeae-ce14-4a40-b763-17c8d972c94b tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172fb1dca7c24ffdba4d10b34ba45fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84146bd4aa1425c843ad28653586d7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:13:45.277774 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-ae05eeae-ce14-4a40-b763-17c8d972c94b tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] 10.222.0.48 "GET /compute/v2.1/servers/f47e787d-a1f9-446c-bb14-a1ad28f80217" status: 200 len: 1313 microversion: 2.1 time: 0.172510 Aug 11 11:13:45.278357 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 555/1127] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:13:45 2022] GET /compute/v2.1/servers/f47e787d-a1f9-446c-bb14-a1ad28f80217 => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:13:45.371374 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-ba642a0d-3848-4d85-ba92-421cc7b66500 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:13:45.372048 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-ba642a0d-3848-4d85-ba92-421cc7b66500 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: 5a7a6694-e9a6-4914-a702-51fcc95a5233] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:13:45.379381 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ba642a0d-3848-4d85-ba92-421cc7b66500 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:45.379901 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ba642a0d-3848-4d85-ba92-421cc7b66500 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:45.380333 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ba642a0d-3848-4d85-ba92-421cc7b66500 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:45.381028 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ba642a0d-3848-4d85-ba92-421cc7b66500 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:45.381476 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ba642a0d-3848-4d85-ba92-421cc7b66500 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:45.381913 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ba642a0d-3848-4d85-ba92-421cc7b66500 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:45.382720 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell0:SELECT=2 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:13:45.436894 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-bdcd6a6c-5c68-4975-a446-ed06b538faec req-4a84bf37-77be-4e82-9476-4e8742c38760 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f47e787d-a1f9-446c-bb14-a1ad28f80217", "name": "network-vif-plugged", "status": "completed", "tag": "3c2d47ce-29ed-4283-aac9-710d2b41e65f"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:13:45.448582 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-bdcd6a6c-5c68-4975-a446-ed06b538faec req-4a84bf37-77be-4e82-9476-4e8742c38760 service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:45.449542 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-bdcd6a6c-5c68-4975-a446-ed06b538faec req-4a84bf37-77be-4e82-9476-4e8742c38760 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:45.450341 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-bdcd6a6c-5c68-4975-a446-ed06b538faec req-4a84bf37-77be-4e82-9476-4e8742c38760 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:45.463674 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-bdcd6a6c-5c68-4975-a446-ed06b538faec req-4a84bf37-77be-4e82-9476-4e8742c38760 service nova] Creating event network-vif-plugged:3c2d47ce-29ed-4283-aac9-710d2b41e65f for instance f47e787d-a1f9-446c-bb14-a1ad28f80217 on hv-cinder-82002 Aug 11 11:13:45.469428 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-bdcd6a6c-5c68-4975-a446-ed06b538faec req-4a84bf37-77be-4e82-9476-4e8742c38760 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036213 Aug 11 11:13:45.470030 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 556/1128] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:13:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:13:45.525015 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-ba642a0d-3848-4d85-ba92-421cc7b66500 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08d81bcd5a4f43ce8b4839ee15cb163b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56bd2a662e34a6395117027b5c28c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:13:45.532783 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-ba642a0d-3848-4d85-ba92-421cc7b66500 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7a6694-e9a6-4914-a702-51fcc95a5233" status: 200 len: 1680 microversion: 2.1 time: 0.166186 Aug 11 11:13:45.533349 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 573/1129] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:13:45 2022] GET /compute/v2.1/servers/5a7a6694-e9a6-4914-a702-51fcc95a5233 => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:13:46.301800 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-a57e518b-a092-461f-a238-6fa8a8bb49a1 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:13:46.302510 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-a57e518b-a092-461f-a238-6fa8a8bb49a1 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] [instance: f47e787d-a1f9-446c-bb14-a1ad28f80217] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:13:46.308869 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a57e518b-a092-461f-a238-6fa8a8bb49a1 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:46.309350 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a57e518b-a092-461f-a238-6fa8a8bb49a1 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:46.309785 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a57e518b-a092-461f-a238-6fa8a8bb49a1 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:46.310473 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a57e518b-a092-461f-a238-6fa8a8bb49a1 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:46.310924 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a57e518b-a092-461f-a238-6fa8a8bb49a1 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:46.311349 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a57e518b-a092-461f-a238-6fa8a8bb49a1 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:46.443181 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-a57e518b-a092-461f-a238-6fa8a8bb49a1 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172fb1dca7c24ffdba4d10b34ba45fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84146bd4aa1425c843ad28653586d7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:13:46.450754 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-a57e518b-a092-461f-a238-6fa8a8bb49a1 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] 10.222.0.48 "GET /compute/v2.1/servers/f47e787d-a1f9-446c-bb14-a1ad28f80217" status: 200 len: 1313 microversion: 2.1 time: 0.154582 Aug 11 11:13:46.451512 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 557/1130] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:13:46 2022] GET /compute/v2.1/servers/f47e787d-a1f9-446c-bb14-a1ad28f80217 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:13:46.553818 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-ddf82e81-a3a0-4e4b-8100-08d98d82d7a5 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:13:46.559130 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-ddf82e81-a3a0-4e4b-8100-08d98d82d7a5 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: 5a7a6694-e9a6-4914-a702-51fcc95a5233] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:13:46.561183 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ddf82e81-a3a0-4e4b-8100-08d98d82d7a5 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:46.561647 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ddf82e81-a3a0-4e4b-8100-08d98d82d7a5 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:46.562078 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ddf82e81-a3a0-4e4b-8100-08d98d82d7a5 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:46.562756 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ddf82e81-a3a0-4e4b-8100-08d98d82d7a5 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:46.563200 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ddf82e81-a3a0-4e4b-8100-08d98d82d7a5 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:46.563623 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-ddf82e81-a3a0-4e4b-8100-08d98d82d7a5 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:46.579046 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:13:46.705229 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-ddf82e81-a3a0-4e4b-8100-08d98d82d7a5 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08d81bcd5a4f43ce8b4839ee15cb163b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56bd2a662e34a6395117027b5c28c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:13:46.713192 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-ddf82e81-a3a0-4e4b-8100-08d98d82d7a5 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7a6694-e9a6-4914-a702-51fcc95a5233" status: 200 len: 1680 microversion: 2.1 time: 0.163302 Aug 11 11:13:46.713762 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 574/1131] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:13:46 2022] GET /compute/v2.1/servers/5a7a6694-e9a6-4914-a702-51fcc95a5233 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:13:47.024333 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-4314c507-eb3b-4b10-9dc8-f7d4247514b8 req-e3d89654-0811-4aa2-a672-980cc03e9ee7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a7a6694-e9a6-4914-a702-51fcc95a5233", "name": "network-vif-deleted", "tag": "adba626d-2eea-4612-bdc0-e917909acfe1"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:13:47.034505 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-4314c507-eb3b-4b10-9dc8-f7d4247514b8 req-e3d89654-0811-4aa2-a672-980cc03e9ee7 service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:47.045730 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-4314c507-eb3b-4b10-9dc8-f7d4247514b8 req-e3d89654-0811-4aa2-a672-980cc03e9ee7 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:47.045730 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-4314c507-eb3b-4b10-9dc8-f7d4247514b8 req-e3d89654-0811-4aa2-a672-980cc03e9ee7 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:47.047419 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-4314c507-eb3b-4b10-9dc8-f7d4247514b8 req-e3d89654-0811-4aa2-a672-980cc03e9ee7 service nova] Creating event network-vif-deleted:adba626d-2eea-4612-bdc0-e917909acfe1 for instance 5a7a6694-e9a6-4914-a702-51fcc95a5233 on hv-cinder-82002 Aug 11 11:13:47.053563 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-4314c507-eb3b-4b10-9dc8-f7d4247514b8 req-e3d89654-0811-4aa2-a672-980cc03e9ee7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033022 Aug 11 11:13:47.054170 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 558/1132] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:13:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:13:47.471997 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-510d62a2-d5da-4e5d-8f4c-9a5534761ba0 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:13:47.472618 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-510d62a2-d5da-4e5d-8f4c-9a5534761ba0 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] [instance: f47e787d-a1f9-446c-bb14-a1ad28f80217] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:13:47.480321 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-510d62a2-d5da-4e5d-8f4c-9a5534761ba0 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:47.480818 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-510d62a2-d5da-4e5d-8f4c-9a5534761ba0 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:47.481257 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-510d62a2-d5da-4e5d-8f4c-9a5534761ba0 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:47.481966 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-510d62a2-d5da-4e5d-8f4c-9a5534761ba0 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:47.482437 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-510d62a2-d5da-4e5d-8f4c-9a5534761ba0 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:47.482849 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-510d62a2-d5da-4e5d-8f4c-9a5534761ba0 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:47.624081 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-510d62a2-d5da-4e5d-8f4c-9a5534761ba0 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172fb1dca7c24ffdba4d10b34ba45fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84146bd4aa1425c843ad28653586d7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:13:47.631397 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-510d62a2-d5da-4e5d-8f4c-9a5534761ba0 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] 10.222.0.48 "GET /compute/v2.1/servers/f47e787d-a1f9-446c-bb14-a1ad28f80217" status: 200 len: 1313 microversion: 2.1 time: 0.163543 Aug 11 11:13:47.631998 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 575/1133] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:13:47 2022] GET /compute/v2.1/servers/f47e787d-a1f9-446c-bb14-a1ad28f80217 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:13:47.735011 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-160af230-2c74-4a6a-b40e-0b07e24ada7f tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:13:47.735745 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-160af230-2c74-4a6a-b40e-0b07e24ada7f tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: 5a7a6694-e9a6-4914-a702-51fcc95a5233] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:13:47.743170 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-160af230-2c74-4a6a-b40e-0b07e24ada7f tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:47.743666 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-160af230-2c74-4a6a-b40e-0b07e24ada7f tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:47.744131 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-160af230-2c74-4a6a-b40e-0b07e24ada7f tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:47.744834 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-160af230-2c74-4a6a-b40e-0b07e24ada7f tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:47.745297 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-160af230-2c74-4a6a-b40e-0b07e24ada7f tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:47.745725 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-160af230-2c74-4a6a-b40e-0b07e24ada7f tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:47.815663 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-160af230-2c74-4a6a-b40e-0b07e24ada7f tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08d81bcd5a4f43ce8b4839ee15cb163b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56bd2a662e34a6395117027b5c28c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:13:47.825154 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-160af230-2c74-4a6a-b40e-0b07e24ada7f tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7a6694-e9a6-4914-a702-51fcc95a5233" status: 200 len: 1325 microversion: 2.1 time: 0.094221 Aug 11 11:13:47.826263 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 559/1134] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:13:47 2022] GET /compute/v2.1/servers/5a7a6694-e9a6-4914-a702-51fcc95a5233 => generated 1325 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:13:48.652667 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-52f93c7f-0f6e-4e33-a047-952e349a7a21 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:13:48.653279 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-52f93c7f-0f6e-4e33-a047-952e349a7a21 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] [instance: f47e787d-a1f9-446c-bb14-a1ad28f80217] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:13:48.660064 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-52f93c7f-0f6e-4e33-a047-952e349a7a21 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:48.661251 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-52f93c7f-0f6e-4e33-a047-952e349a7a21 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:48.661251 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-52f93c7f-0f6e-4e33-a047-952e349a7a21 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:48.661691 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-52f93c7f-0f6e-4e33-a047-952e349a7a21 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:48.662147 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-52f93c7f-0f6e-4e33-a047-952e349a7a21 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:48.662592 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-52f93c7f-0f6e-4e33-a047-952e349a7a21 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:48.798200 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-52f93c7f-0f6e-4e33-a047-952e349a7a21 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172fb1dca7c24ffdba4d10b34ba45fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84146bd4aa1425c843ad28653586d7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:13:48.806269 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-52f93c7f-0f6e-4e33-a047-952e349a7a21 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] 10.222.0.48 "GET /compute/v2.1/servers/f47e787d-a1f9-446c-bb14-a1ad28f80217" status: 200 len: 1496 microversion: 2.1 time: 0.157503 Aug 11 11:13:48.806901 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 576/1135] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:13:48 2022] GET /compute/v2.1/servers/f47e787d-a1f9-446c-bb14-a1ad28f80217 => generated 1496 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:13:48.846171 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-ad5d26d4-1db8-4fc1-b489-2eff094e8fae tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:13:48.846672 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-ad5d26d4-1db8-4fc1-b489-2eff094e8fae tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: 5a7a6694-e9a6-4914-a702-51fcc95a5233] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:13:48.856330 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ad5d26d4-1db8-4fc1-b489-2eff094e8fae tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:48.856330 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ad5d26d4-1db8-4fc1-b489-2eff094e8fae tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:48.856330 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ad5d26d4-1db8-4fc1-b489-2eff094e8fae tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:48.856330 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ad5d26d4-1db8-4fc1-b489-2eff094e8fae tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:48.856649 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ad5d26d4-1db8-4fc1-b489-2eff094e8fae tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:48.856649 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ad5d26d4-1db8-4fc1-b489-2eff094e8fae tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:48.869549 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.wsgi [None req-ad5d26d4-1db8-4fc1-b489-2eff094e8fae tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] HTTP exception thrown: Instance 5a7a6694-e9a6-4914-a702-51fcc95a5233 could not be found. Aug 11 11:13:48.871226 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-ad5d26d4-1db8-4fc1-b489-2eff094e8fae tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Request method failure captured: Aug 11 11:13:48.871226 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: request: GET /compute/v2.1/servers/5a7a6694-e9a6-4914-a702-51fcc95a5233 HTTP/1.1 Aug 11 11:13:48.871226 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Accept: application/json Aug 11 11:13:48.871226 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Accept-Encoding: identity Aug 11 11:13:48.871226 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Connection: close Aug 11 11:13:48.871226 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Content-Length: 0 Aug 11 11:13:48.871226 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Content-Type: application/json Aug 11 11:13:48.871226 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Host: 10.222.0.48 Aug 11 11:13:48.871226 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Openstack-System-Scope: None Aug 11 11:13:48.871226 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: User-Agent: python-urllib3/1.26.11 Aug 11 11:13:48.871226 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Auth-Token: gAAAAABi9ONxPYWpRmadpANSM5f1tl1wVESW1SFE62fiY511YI9uU6D_79r-yuQvgjKjvFqPWeHAiFZFw3kYac2M1zqDX4QPozx6rX_pgfB-Fgz47x90y_mKI7zGyyPs8EkLoYDiomkPvd5a4fE5iPsTlEJ3RRgCL7XDnuCGisjN8PsW1aCU_y4 Aug 11 11:13:48.871226 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Domain-Id: None Aug 11 11:13:48.871226 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Domain-Name: None Aug 11 11:13:48.871226 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Identity-Status: Confirmed Aug 11 11:13:48.871226 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Is-Admin-Project: True Aug 11 11:13:48.871226 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Domain-Id: default Aug 11 11:13:48.871226 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Domain-Name: Default Aug 11 11:13:48.871226 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Id: c56bd2a662e34a6395117027b5c28c5b Aug 11 11:13:48.871226 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Name: tempest-AttachVolumeNegativeTest-848160622 Aug 11 11:13:48.871226 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Role: reader,member Aug 11 11:13:48.871226 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Roles: reader,member Aug 11 11:13:48.872953 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c56bd2a662e34a6395117027b5c28c5b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c56bd2a662e34a6395117027b5c28c5b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c56bd2a662e34a6395117027b5c28c5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c56bd2a662e34a6395117027b5c28c5b", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] Aug 11 11:13:48.872953 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant: tempest-AttachVolumeNegativeTest-848160622 Aug 11 11:13:48.872953 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant-Id: c56bd2a662e34a6395117027b5c28c5b Aug 11 11:13:48.872953 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-848160622 Aug 11 11:13:48.872953 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User: tempest-AttachVolumeNegativeTest-848160622-project Aug 11 11:13:48.872953 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Domain-Id: default Aug 11 11:13:48.872953 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Domain-Name: Default Aug 11 11:13:48.872953 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Id: 08d81bcd5a4f43ce8b4839ee15cb163b Aug 11 11:13:48.872953 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Name: tempest-AttachVolumeNegativeTest-848160622-project Aug 11 11:13:48.872953 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: method: > Aug 11 11:13:48.872953 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: exception: Instance 5a7a6694-e9a6-4914-a702-51fcc95a5233 could not be found. Aug 11 11:13:48.872953 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: action_args: {'id': '5a7a6694-e9a6-4914-a702-51fcc95a5233'} Aug 11 11:13:48.873861 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 11:13:48.873861 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:13:48.873861 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 11:13:48.873861 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 11:13:48.873861 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 11:13:48.873861 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 11:13:48.873861 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 11:13:48.873861 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 11:13:48.873861 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 11:13:48.873861 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 11:13:48.873861 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a7a6694-e9a6-4914-a702-51fcc95a5233 could not be found. Aug 11 11:13:48.873861 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:13:48.873861 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:13:48.873861 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:13:48.873861 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:13:48.873861 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:13:48.873861 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:13:48.873861 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 11:13:48.873861 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 11:13:48.873861 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 11:13:48.875449 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 11:13:48.875449 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 11:13:48.875449 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 11:13:48.875449 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 11:13:48.875449 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 11:13:48.875449 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 11:13:48.875449 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 11:13:48.875449 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a7a6694-e9a6-4914-a702-51fcc95a5233 could not be found. Aug 11 11:13:48.875449 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:13:48.875449 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:13:48.875449 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:13:48.875449 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:13:48.875449 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:13:48.875449 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:13:48.875449 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 11:13:48.875449 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 11:13:48.875449 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a7a6694-e9a6-4914-a702-51fcc95a5233 could not be found. Aug 11 11:13:48.875449 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:13:48.876856 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-ad5d26d4-1db8-4fc1-b489-2eff094e8fae tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Returning 404 to user: Instance 5a7a6694-e9a6-4914-a702-51fcc95a5233 could not be found. {{(pid=121231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 11:13:48.876856 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-ad5d26d4-1db8-4fc1-b489-2eff094e8fae tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7a6694-e9a6-4914-a702-51fcc95a5233" status: 404 len: 111 microversion: 2.1 time: 0.030571 Aug 11 11:13:48.876856 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 560/1136] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:13:48 2022] GET /compute/v2.1/servers/5a7a6694-e9a6-4914-a702-51fcc95a5233 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 11:13:48.882819 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-0186139f-a119-4ebc-a72f-d38b90cc0826 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '.version_select at 0x7faab0bdadc0>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:13:48.994933 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-0186139f-a119-4ebc-a72f-d38b90cc0826 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-166222037" status: 202 len: 0 microversion: 2.1 time: 0.116552 Aug 11 11:13:48.995509 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 577/1137] 10.222.0.48 () {58 vars in 1218 bytes} [Thu Aug 11 11:13:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-166222037 => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 11:13:49.814394 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-c39db076-a91b-4dcc-8125-1c1d3293389f tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Action: 'create', calling method: .version_select at 0x7faab0cec4c0>, body: {"keypair": {"name": "tempest-keypair-1733680468", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPo3kIYEOdN9DnG3eMYR01g1DRcriW0P9M26j0RtHi28wawRqwdz/K/hJyH/mwmKJZYKWtaexCXNaLg2dcqgG/uN/uWzPmTYTNEqEh84tHQAQQW1eFugcC2EgX0Y06Gw3g=="}} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:13:49.814618 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-2f137313-ec4c-4d07-95b9-a0a804e464d2 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:13:49.815064 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-2f137313-ec4c-4d07-95b9-a0a804e464d2 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] [instance: f47e787d-a1f9-446c-bb14-a1ad28f80217] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:13:49.822367 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2f137313-ec4c-4d07-95b9-a0a804e464d2 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:49.833753 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2f137313-ec4c-4d07-95b9-a0a804e464d2 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:49.833753 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2f137313-ec4c-4d07-95b9-a0a804e464d2 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:49.833753 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2f137313-ec4c-4d07-95b9-a0a804e464d2 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:49.833753 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2f137313-ec4c-4d07-95b9-a0a804e464d2 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:49.834864 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2f137313-ec4c-4d07-95b9-a0a804e464d2 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:49.834969 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.quota [None req-c39db076-a91b-4dcc-8125-1c1d3293389f tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Getting quotas for project c56bd2a662e34a6395117027b5c28c5b. Resources: {'key_pairs'} {{(pid=121231) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 11:13:49.836065 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.quota [None req-c39db076-a91b-4dcc-8125-1c1d3293389f tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Getting quotas for user 08d81bcd5a4f43ce8b4839ee15cb163b and project c56bd2a662e34a6395117027b5c28c5b. Resources: {'key_pairs'} {{(pid=121231) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 11:13:49.853101 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-2f137313-ec4c-4d07-95b9-a0a804e464d2 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] [instance: f47e787d-a1f9-446c-bb14-a1ad28f80217] Going to try to terminate instance {{(pid=121232) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 11 11:13:49.950028 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-c39db076-a91b-4dcc-8125-1c1d3293389f tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.139886 Aug 11 11:13:49.950640 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 561/1138] 10.222.0.48 () {60 vars in 1159 bytes} [Thu Aug 11 11:13:49 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 11:13:50.200493 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-2f137313-ec4c-4d07-95b9-a0a804e464d2 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f47e787d-a1f9-446c-bb14-a1ad28f80217" status: 204 len: 0 microversion: 2.1 time: 0.389292 Aug 11 11:13:50.201012 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 578/1139] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Aug 11 11:13:49 2022] DELETE /compute/v2.1/servers/f47e787d-a1f9-446c-bb14-a1ad28f80217 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 11 11:13:50.209182 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-92c7d43b-f20e-4075-999e-b4de733cb7ad tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:13:50.210289 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-92c7d43b-f20e-4075-999e-b4de733cb7ad tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] [instance: f47e787d-a1f9-446c-bb14-a1ad28f80217] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:13:50.217172 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-92c7d43b-f20e-4075-999e-b4de733cb7ad tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:50.217653 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-92c7d43b-f20e-4075-999e-b4de733cb7ad tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:50.218083 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-92c7d43b-f20e-4075-999e-b4de733cb7ad tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:50.218753 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-92c7d43b-f20e-4075-999e-b4de733cb7ad tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:50.219203 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-92c7d43b-f20e-4075-999e-b4de733cb7ad tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:50.219618 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-92c7d43b-f20e-4075-999e-b4de733cb7ad tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:50.372196 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-92c7d43b-f20e-4075-999e-b4de733cb7ad tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172fb1dca7c24ffdba4d10b34ba45fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84146bd4aa1425c843ad28653586d7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:13:50.379933 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-92c7d43b-f20e-4075-999e-b4de733cb7ad tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] 10.222.0.48 "GET /compute/v2.1/servers/f47e787d-a1f9-446c-bb14-a1ad28f80217" status: 200 len: 1502 microversion: 2.1 time: 0.174634 Aug 11 11:13:50.380499 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 562/1140] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:13:50 2022] GET /compute/v2.1/servers/f47e787d-a1f9-446c-bb14-a1ad28f80217 => generated 1502 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:13:51.402197 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-1778a8b6-6e1a-49de-ab65-4965a44bd5e1 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:13:51.403326 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-1778a8b6-6e1a-49de-ab65-4965a44bd5e1 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] [instance: f47e787d-a1f9-446c-bb14-a1ad28f80217] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:13:51.409699 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1778a8b6-6e1a-49de-ab65-4965a44bd5e1 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:51.410227 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1778a8b6-6e1a-49de-ab65-4965a44bd5e1 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:51.410653 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1778a8b6-6e1a-49de-ab65-4965a44bd5e1 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:51.411339 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1778a8b6-6e1a-49de-ab65-4965a44bd5e1 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:51.411807 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1778a8b6-6e1a-49de-ab65-4965a44bd5e1 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:51.412234 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1778a8b6-6e1a-49de-ab65-4965a44bd5e1 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:51.545959 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-1778a8b6-6e1a-49de-ab65-4965a44bd5e1 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172fb1dca7c24ffdba4d10b34ba45fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84146bd4aa1425c843ad28653586d7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:13:51.556328 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-1778a8b6-6e1a-49de-ab65-4965a44bd5e1 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] 10.222.0.48 "GET /compute/v2.1/servers/f47e787d-a1f9-446c-bb14-a1ad28f80217" status: 200 len: 1502 microversion: 2.1 time: 0.159191 Aug 11 11:13:51.557010 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 579/1141] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:13:51 2022] GET /compute/v2.1/servers/f47e787d-a1f9-446c-bb14-a1ad28f80217 => generated 1502 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:13:52.578108 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-c426760d-f6b0-4ea7-8874-fd4cc05184ea tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:13:52.578710 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-c426760d-f6b0-4ea7-8874-fd4cc05184ea tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] [instance: f47e787d-a1f9-446c-bb14-a1ad28f80217] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:13:52.585321 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c426760d-f6b0-4ea7-8874-fd4cc05184ea tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:52.585811 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c426760d-f6b0-4ea7-8874-fd4cc05184ea tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:52.586773 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c426760d-f6b0-4ea7-8874-fd4cc05184ea tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:52.587472 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c426760d-f6b0-4ea7-8874-fd4cc05184ea tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:52.587956 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c426760d-f6b0-4ea7-8874-fd4cc05184ea tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:52.588381 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c426760d-f6b0-4ea7-8874-fd4cc05184ea tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:52.732474 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-c426760d-f6b0-4ea7-8874-fd4cc05184ea tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172fb1dca7c24ffdba4d10b34ba45fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84146bd4aa1425c843ad28653586d7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:13:52.740818 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-c426760d-f6b0-4ea7-8874-fd4cc05184ea tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] 10.222.0.48 "GET /compute/v2.1/servers/f47e787d-a1f9-446c-bb14-a1ad28f80217" status: 200 len: 1502 microversion: 2.1 time: 0.166291 Aug 11 11:13:52.741701 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 563/1142] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:13:52 2022] GET /compute/v2.1/servers/f47e787d-a1f9-446c-bb14-a1ad28f80217 => generated 1502 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:13:52.746982 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-d58580c6-a41d-4e12-8afe-6d7b4e02da69 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2141574821", "imageRef": "05993162-aafd-4f1d-b781-ec09593713e5", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e9237d16-c254-4c91-b4d6-ffa10fd31ebe"}], "security_groups": [{"name": "tempest-securitygroup--1032911677"}], "key_name": "tempest-keypair-1733680468", "user_data": "}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:13:52.785953 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-97faf574-1ed0-4f8c-909a-f578b087a9c4 req-20d1cf91-49e0-42dc-bd24-8f984d92d396 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f47e787d-a1f9-446c-bb14-a1ad28f80217", "name": "network-vif-deleted", "tag": "3c2d47ce-29ed-4283-aac9-710d2b41e65f"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:13:52.796566 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-97faf574-1ed0-4f8c-909a-f578b087a9c4 req-20d1cf91-49e0-42dc-bd24-8f984d92d396 service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:52.797041 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-97faf574-1ed0-4f8c-909a-f578b087a9c4 req-20d1cf91-49e0-42dc-bd24-8f984d92d396 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:52.797661 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-97faf574-1ed0-4f8c-909a-f578b087a9c4 req-20d1cf91-49e0-42dc-bd24-8f984d92d396 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:52.801731 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:13:52.808996 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-97faf574-1ed0-4f8c-909a-f578b087a9c4 req-20d1cf91-49e0-42dc-bd24-8f984d92d396 service nova] Creating event network-vif-deleted:3c2d47ce-29ed-4283-aac9-710d2b41e65f for instance f47e787d-a1f9-446c-bb14-a1ad28f80217 on hv-cinder-82002 Aug 11 11:13:52.814368 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-97faf574-1ed0-4f8c-909a-f578b087a9c4 req-20d1cf91-49e0-42dc-bd24-8f984d92d396 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032395 Aug 11 11:13:52.814962 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 564/1143] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:13:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 11:13:52.860954 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.network.neutron [None req-d58580c6-a41d-4e12-8afe-6d7b4e02da69 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] validate_networks() for [('e9237d16-c254-4c91-b4d6-ffa10fd31ebe', None, None, None, None, None)] {{(pid=121232) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 11 11:13:53.247996 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-d58580c6-a41d-4e12-8afe-6d7b4e02da69 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Flavor limits 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 11 11:13:53.248412 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-d58580c6-a41d-4e12-8afe-6d7b4e02da69 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Image limits 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 11 11:13:53.248877 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-d58580c6-a41d-4e12-8afe-6d7b4e02da69 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Flavor pref 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 11 11:13:53.249280 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-d58580c6-a41d-4e12-8afe-6d7b4e02da69 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Image pref 0:0:0 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 11 11:13:53.249717 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.virt.hardware [None req-d58580c6-a41d-4e12-8afe-6d7b4e02da69 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121232) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 11 11:13:53.258745 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d58580c6-a41d-4e12-8afe-6d7b4e02da69 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:53.259212 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d58580c6-a41d-4e12-8afe-6d7b4e02da69 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:53.259644 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d58580c6-a41d-4e12-8afe-6d7b4e02da69 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:53.260389 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d58580c6-a41d-4e12-8afe-6d7b4e02da69 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:53.260835 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d58580c6-a41d-4e12-8afe-6d7b4e02da69 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:53.261251 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d58580c6-a41d-4e12-8afe-6d7b4e02da69 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:53.280072 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-d58580c6-a41d-4e12-8afe-6d7b4e02da69 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Getting quotas for project c56bd2a662e34a6395117027b5c28c5b. Resources: {'ram', 'cores', 'instances'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 11:13:53.284047 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.quota [None req-d58580c6-a41d-4e12-8afe-6d7b4e02da69 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Getting quotas for user 08d81bcd5a4f43ce8b4839ee15cb163b and project c56bd2a662e34a6395117027b5c28c5b. Resources: {'ram', 'cores', 'instances'} {{(pid=121232) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 11:13:53.295732 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-d58580c6-a41d-4e12-8afe-6d7b4e02da69 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Going to run 1 instances... {{(pid=121232) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 11 11:13:53.297990 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-d58580c6-a41d-4e12-8afe-6d7b4e02da69 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: 1fbce1d9-88f9-46f8-96c6-04dd43180259] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='05993162-aafd-4f1d-b781-ec09593713e5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121232) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 11 11:13:53.415816 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-d58580c6-a41d-4e12-8afe-6d7b4e02da69 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.678749 Aug 11 11:13:53.416598 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 580/1144] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Aug 11 11:13:52 2022] POST /compute/v2.1/servers => generated 402 bytes in 680 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 11 11:13:53.428282 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-d0979259-14fc-457d-96c9-d4312f6820dd tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:13:53.429006 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-d0979259-14fc-457d-96c9-d4312f6820dd tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: 1fbce1d9-88f9-46f8-96c6-04dd43180259] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:13:53.484632 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-d0979259-14fc-457d-96c9-d4312f6820dd tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08d81bcd5a4f43ce8b4839ee15cb163b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56bd2a662e34a6395117027b5c28c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:13:53.491889 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-d0979259-14fc-457d-96c9-d4312f6820dd tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/1fbce1d9-88f9-46f8-96c6-04dd43180259" status: 200 len: 1242 microversion: 2.1 time: 0.068152 Aug 11 11:13:53.492581 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 565/1145] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:13:53 2022] GET /compute/v2.1/servers/1fbce1d9-88f9-46f8-96c6-04dd43180259 => generated 1242 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:13:53.762776 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-1d85fd85-3f09-4ef1-87fc-645af62061b0 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:13:53.763396 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-1d85fd85-3f09-4ef1-87fc-645af62061b0 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] [instance: f47e787d-a1f9-446c-bb14-a1ad28f80217] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:13:53.769516 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1d85fd85-3f09-4ef1-87fc-645af62061b0 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:53.770041 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1d85fd85-3f09-4ef1-87fc-645af62061b0 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:53.770431 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1d85fd85-3f09-4ef1-87fc-645af62061b0 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:53.771120 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1d85fd85-3f09-4ef1-87fc-645af62061b0 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:53.771572 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1d85fd85-3f09-4ef1-87fc-645af62061b0 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:53.772015 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1d85fd85-3f09-4ef1-87fc-645af62061b0 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:53.802675 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1d85fd85-3f09-4ef1-87fc-645af62061b0 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:53.803149 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1d85fd85-3f09-4ef1-87fc-645af62061b0 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:53.803580 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1d85fd85-3f09-4ef1-87fc-645af62061b0 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:53.804050 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.objects.instance [None req-1d85fd85-3f09-4ef1-87fc-645af62061b0 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lazy-loading 'fault' on Instance uuid f47e787d-a1f9-446c-bb14-a1ad28f80217 {{(pid=121232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 11:13:53.845012 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-1d85fd85-3f09-4ef1-87fc-645af62061b0 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '172fb1dca7c24ffdba4d10b34ba45fe5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b84146bd4aa1425c843ad28653586d7a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:13:53.852859 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-1d85fd85-3f09-4ef1-87fc-645af62061b0 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] 10.222.0.48 "GET /compute/v2.1/servers/f47e787d-a1f9-446c-bb14-a1ad28f80217" status: 200 len: 1303 microversion: 2.1 time: 0.095042 Aug 11 11:13:53.853416 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 581/1146] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:13:53 2022] GET /compute/v2.1/servers/f47e787d-a1f9-446c-bb14-a1ad28f80217 => generated 1303 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:13:54.512324 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-84d2000b-3952-4432-8a48-1691c32eb851 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:13:54.512950 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-84d2000b-3952-4432-8a48-1691c32eb851 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: 1fbce1d9-88f9-46f8-96c6-04dd43180259] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:13:54.520174 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-84d2000b-3952-4432-8a48-1691c32eb851 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:54.520703 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-84d2000b-3952-4432-8a48-1691c32eb851 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:54.521130 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-84d2000b-3952-4432-8a48-1691c32eb851 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:54.521806 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-84d2000b-3952-4432-8a48-1691c32eb851 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:54.522248 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-84d2000b-3952-4432-8a48-1691c32eb851 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:54.522664 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-84d2000b-3952-4432-8a48-1691c32eb851 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:54.583670 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-84d2000b-3952-4432-8a48-1691c32eb851 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08d81bcd5a4f43ce8b4839ee15cb163b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56bd2a662e34a6395117027b5c28c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:13:54.591123 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-84d2000b-3952-4432-8a48-1691c32eb851 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/1fbce1d9-88f9-46f8-96c6-04dd43180259" status: 200 len: 1246 microversion: 2.1 time: 0.082664 Aug 11 11:13:54.591690 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 566/1147] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:13:54 2022] GET /compute/v2.1/servers/1fbce1d9-88f9-46f8-96c6-04dd43180259 => generated 1246 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:13:54.874285 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-b3f71210-4c1b-43ff-a7ac-6540abdca4f5 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:13:54.874988 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-b3f71210-4c1b-43ff-a7ac-6540abdca4f5 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] [instance: f47e787d-a1f9-446c-bb14-a1ad28f80217] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:13:54.881834 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b3f71210-4c1b-43ff-a7ac-6540abdca4f5 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:54.882418 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b3f71210-4c1b-43ff-a7ac-6540abdca4f5 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:54.884741 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b3f71210-4c1b-43ff-a7ac-6540abdca4f5 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:54.884741 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b3f71210-4c1b-43ff-a7ac-6540abdca4f5 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:54.884741 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b3f71210-4c1b-43ff-a7ac-6540abdca4f5 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:54.884741 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b3f71210-4c1b-43ff-a7ac-6540abdca4f5 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:54.898069 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.wsgi [None req-b3f71210-4c1b-43ff-a7ac-6540abdca4f5 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] HTTP exception thrown: Instance f47e787d-a1f9-446c-bb14-a1ad28f80217 could not be found. Aug 11 11:13:54.900335 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-b3f71210-4c1b-43ff-a7ac-6540abdca4f5 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Request method failure captured: Aug 11 11:13:54.900335 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: request: GET /compute/v2.1/servers/f47e787d-a1f9-446c-bb14-a1ad28f80217 HTTP/1.1 Aug 11 11:13:54.900335 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Accept: application/json Aug 11 11:13:54.900335 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Accept-Encoding: identity Aug 11 11:13:54.900335 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Connection: close Aug 11 11:13:54.900335 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Content-Length: 0 Aug 11 11:13:54.900335 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Content-Type: application/json Aug 11 11:13:54.900335 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Host: 10.222.0.48 Aug 11 11:13:54.900335 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Openstack-System-Scope: None Aug 11 11:13:54.900335 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: User-Agent: python-urllib3/1.26.11 Aug 11 11:13:54.900335 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Auth-Token: gAAAAABi9ORFYneY3q7WmJj3VO8n-l2bU2PioJMSGkY23RAw0kA9kqWryP-1SeqGprdDTaM0zE7meNsBU1s1QBeoWdlS8254bGObucSWmyXZ1eILlvhPGyHa-svV385nOcYkFn3t7NN9L4LCagpWnzBA48QdI4Kgf6C73R4mG80WcGWvk8HkmXA Aug 11 11:13:54.900335 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Domain-Id: None Aug 11 11:13:54.900335 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Domain-Name: None Aug 11 11:13:54.900335 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Identity-Status: Confirmed Aug 11 11:13:54.900335 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Is-Admin-Project: True Aug 11 11:13:54.900335 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Domain-Id: default Aug 11 11:13:54.900335 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Domain-Name: Default Aug 11 11:13:54.900335 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Id: b84146bd4aa1425c843ad28653586d7a Aug 11 11:13:54.900335 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Name: tempest-VolumesActionsTest-1717920515 Aug 11 11:13:54.900335 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Role: reader,member Aug 11 11:13:54.900335 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Roles: reader,member Aug 11 11:13:54.902026 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b84146bd4aa1425c843ad28653586d7a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b84146bd4aa1425c843ad28653586d7a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b84146bd4aa1425c843ad28653586d7a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b84146bd4aa1425c843ad28653586d7a", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] Aug 11 11:13:54.902026 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Tenant: tempest-VolumesActionsTest-1717920515 Aug 11 11:13:54.902026 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Tenant-Id: b84146bd4aa1425c843ad28653586d7a Aug 11 11:13:54.902026 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Tenant-Name: tempest-VolumesActionsTest-1717920515 Aug 11 11:13:54.902026 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User: tempest-VolumesActionsTest-1717920515-project Aug 11 11:13:54.902026 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Domain-Id: default Aug 11 11:13:54.902026 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Domain-Name: Default Aug 11 11:13:54.902026 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Id: 172fb1dca7c24ffdba4d10b34ba45fe5 Aug 11 11:13:54.902026 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Name: tempest-VolumesActionsTest-1717920515-project Aug 11 11:13:54.902026 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: method: > Aug 11 11:13:54.902026 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: exception: Instance f47e787d-a1f9-446c-bb14-a1ad28f80217 could not be found. Aug 11 11:13:54.902026 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: action_args: {'id': 'f47e787d-a1f9-446c-bb14-a1ad28f80217'} Aug 11 11:13:54.902888 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 11:13:54.902888 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:13:54.902888 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 11:13:54.902888 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 11:13:54.902888 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 11:13:54.902888 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 11:13:54.902888 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 11:13:54.902888 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 11:13:54.902888 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 11:13:54.902888 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 11:13:54.902888 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f47e787d-a1f9-446c-bb14-a1ad28f80217 could not be found. Aug 11 11:13:54.902888 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:13:54.902888 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:13:54.902888 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:13:54.902888 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:13:54.902888 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:13:54.902888 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:13:54.902888 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 11:13:54.902888 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 11:13:54.902888 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 11:13:54.904447 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 11:13:54.904447 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 11:13:54.904447 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 11:13:54.904447 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 11:13:54.904447 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 11:13:54.904447 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 11:13:54.904447 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 11:13:54.904447 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f47e787d-a1f9-446c-bb14-a1ad28f80217 could not be found. Aug 11 11:13:54.904447 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:13:54.904447 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:13:54.904447 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:13:54.904447 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:13:54.904447 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:13:54.904447 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:13:54.904447 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 11:13:54.904447 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 11:13:54.904447 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f47e787d-a1f9-446c-bb14-a1ad28f80217 could not be found. Aug 11 11:13:54.904447 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:13:54.906069 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-b3f71210-4c1b-43ff-a7ac-6540abdca4f5 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] Returning 404 to user: Instance f47e787d-a1f9-446c-bb14-a1ad28f80217 could not be found. {{(pid=121232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 11:13:54.906069 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-b3f71210-4c1b-43ff-a7ac-6540abdca4f5 tempest-VolumesActionsTest-1717920515 tempest-VolumesActionsTest-1717920515-project] 10.222.0.48 "GET /compute/v2.1/servers/f47e787d-a1f9-446c-bb14-a1ad28f80217" status: 404 len: 111 microversion: 2.1 time: 0.031374 Aug 11 11:13:54.906069 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 582/1148] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:13:54 2022] GET /compute/v2.1/servers/f47e787d-a1f9-446c-bb14-a1ad28f80217 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 11:13:55.617951 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-b72a329f-af26-43e6-8d6b-8b1166701f90 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:13:55.617951 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-b72a329f-af26-43e6-8d6b-8b1166701f90 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: 1fbce1d9-88f9-46f8-96c6-04dd43180259] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:13:55.619313 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b72a329f-af26-43e6-8d6b-8b1166701f90 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:55.619820 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b72a329f-af26-43e6-8d6b-8b1166701f90 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:55.620255 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b72a329f-af26-43e6-8d6b-8b1166701f90 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:55.621055 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b72a329f-af26-43e6-8d6b-8b1166701f90 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:55.621504 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b72a329f-af26-43e6-8d6b-8b1166701f90 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:55.622015 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-b72a329f-af26-43e6-8d6b-8b1166701f90 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:55.697222 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-b72a329f-af26-43e6-8d6b-8b1166701f90 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08d81bcd5a4f43ce8b4839ee15cb163b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56bd2a662e34a6395117027b5c28c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:13:55.705700 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-b72a329f-af26-43e6-8d6b-8b1166701f90 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/1fbce1d9-88f9-46f8-96c6-04dd43180259" status: 200 len: 1294 microversion: 2.1 time: 0.097955 Aug 11 11:13:55.706272 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 567/1149] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:13:55 2022] GET /compute/v2.1/servers/1fbce1d9-88f9-46f8-96c6-04dd43180259 => generated 1294 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:13:56.729449 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-69b9dfb8-4d5c-41e9-9434-e3b3665a7f49 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:13:56.730079 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-69b9dfb8-4d5c-41e9-9434-e3b3665a7f49 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: 1fbce1d9-88f9-46f8-96c6-04dd43180259] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:13:56.736731 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-69b9dfb8-4d5c-41e9-9434-e3b3665a7f49 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:56.737220 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-69b9dfb8-4d5c-41e9-9434-e3b3665a7f49 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:56.737654 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-69b9dfb8-4d5c-41e9-9434-e3b3665a7f49 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:56.738341 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-69b9dfb8-4d5c-41e9-9434-e3b3665a7f49 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:56.738789 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-69b9dfb8-4d5c-41e9-9434-e3b3665a7f49 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:56.739372 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-69b9dfb8-4d5c-41e9-9434-e3b3665a7f49 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:56.882917 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-69b9dfb8-4d5c-41e9-9434-e3b3665a7f49 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08d81bcd5a4f43ce8b4839ee15cb163b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56bd2a662e34a6395117027b5c28c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:13:56.891131 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-69b9dfb8-4d5c-41e9-9434-e3b3665a7f49 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/1fbce1d9-88f9-46f8-96c6-04dd43180259" status: 200 len: 1368 microversion: 2.1 time: 0.165595 Aug 11 11:13:56.891709 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 583/1150] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:13:56 2022] GET /compute/v2.1/servers/1fbce1d9-88f9-46f8-96c6-04dd43180259 => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:13:57.912678 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-4627bfa1-8815-423a-b634-0fb445f031d2 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:13:57.913231 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-4627bfa1-8815-423a-b634-0fb445f031d2 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: 1fbce1d9-88f9-46f8-96c6-04dd43180259] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:13:57.919632 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4627bfa1-8815-423a-b634-0fb445f031d2 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:57.920134 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4627bfa1-8815-423a-b634-0fb445f031d2 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:57.920562 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4627bfa1-8815-423a-b634-0fb445f031d2 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:57.921236 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4627bfa1-8815-423a-b634-0fb445f031d2 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:57.921680 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4627bfa1-8815-423a-b634-0fb445f031d2 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:57.922096 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4627bfa1-8815-423a-b634-0fb445f031d2 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:58.051548 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-4627bfa1-8815-423a-b634-0fb445f031d2 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08d81bcd5a4f43ce8b4839ee15cb163b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56bd2a662e34a6395117027b5c28c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:13:58.059513 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-4627bfa1-8815-423a-b634-0fb445f031d2 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/1fbce1d9-88f9-46f8-96c6-04dd43180259" status: 200 len: 1368 microversion: 2.1 time: 0.150731 Aug 11 11:13:58.060128 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 568/1151] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:13:57 2022] GET /compute/v2.1/servers/1fbce1d9-88f9-46f8-96c6-04dd43180259 => generated 1368 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:13:59.080097 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-1b2a1494-d592-4cc4-90db-cd0907e0f3d5 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:13:59.080729 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-1b2a1494-d592-4cc4-90db-cd0907e0f3d5 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: 1fbce1d9-88f9-46f8-96c6-04dd43180259] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:13:59.087290 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1b2a1494-d592-4cc4-90db-cd0907e0f3d5 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:59.087850 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1b2a1494-d592-4cc4-90db-cd0907e0f3d5 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:59.088246 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1b2a1494-d592-4cc4-90db-cd0907e0f3d5 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:59.088931 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1b2a1494-d592-4cc4-90db-cd0907e0f3d5 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:59.089379 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1b2a1494-d592-4cc4-90db-cd0907e0f3d5 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:59.089799 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-1b2a1494-d592-4cc4-90db-cd0907e0f3d5 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:59.221853 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-1b2a1494-d592-4cc4-90db-cd0907e0f3d5 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08d81bcd5a4f43ce8b4839ee15cb163b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56bd2a662e34a6395117027b5c28c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:13:59.229466 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-1b2a1494-d592-4cc4-90db-cd0907e0f3d5 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/1fbce1d9-88f9-46f8-96c6-04dd43180259" status: 200 len: 1368 microversion: 2.1 time: 0.153203 Aug 11 11:13:59.231803 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 584/1152] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:13:59 2022] GET /compute/v2.1/servers/1fbce1d9-88f9-46f8-96c6-04dd43180259 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:13:59.920476 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-23b4aeef-e0c8-4c85-837c-ad4f6665d63e req-08580a93-99e8-4103-8351-7d1923c1c96f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fbce1d9-88f9-46f8-96c6-04dd43180259", "tag": "d14b79b9-819d-4c3b-b0a3-d9a3809d0ae8"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:13:59.930813 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-23b4aeef-e0c8-4c85-837c-ad4f6665d63e req-08580a93-99e8-4103-8351-7d1923c1c96f service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:13:59.931388 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-23b4aeef-e0c8-4c85-837c-ad4f6665d63e req-08580a93-99e8-4103-8351-7d1923c1c96f service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:13:59.931850 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-23b4aeef-e0c8-4c85-837c-ad4f6665d63e req-08580a93-99e8-4103-8351-7d1923c1c96f service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:13:59.943363 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-23b4aeef-e0c8-4c85-837c-ad4f6665d63e req-08580a93-99e8-4103-8351-7d1923c1c96f service nova] Creating event network-changed:d14b79b9-819d-4c3b-b0a3-d9a3809d0ae8 for instance 1fbce1d9-88f9-46f8-96c6-04dd43180259 on hv-cinder-82002 Aug 11 11:13:59.948308 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-23b4aeef-e0c8-4c85-837c-ad4f6665d63e req-08580a93-99e8-4103-8351-7d1923c1c96f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032152 Aug 11 11:13:59.948892 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 569/1153] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:13:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:14:00.250536 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-4483ce69-3b1c-4664-8dc5-07b2e9428821 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:14:00.251272 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-4483ce69-3b1c-4664-8dc5-07b2e9428821 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: 1fbce1d9-88f9-46f8-96c6-04dd43180259] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:14:00.253730 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:14:00.258375 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4483ce69-3b1c-4664-8dc5-07b2e9428821 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:14:00.258914 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4483ce69-3b1c-4664-8dc5-07b2e9428821 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:14:00.259349 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4483ce69-3b1c-4664-8dc5-07b2e9428821 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:14:00.260060 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4483ce69-3b1c-4664-8dc5-07b2e9428821 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:14:00.260509 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4483ce69-3b1c-4664-8dc5-07b2e9428821 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:14:00.260921 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-4483ce69-3b1c-4664-8dc5-07b2e9428821 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:14:00.405242 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-4483ce69-3b1c-4664-8dc5-07b2e9428821 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08d81bcd5a4f43ce8b4839ee15cb163b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56bd2a662e34a6395117027b5c28c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:14:00.416699 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-4483ce69-3b1c-4664-8dc5-07b2e9428821 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/1fbce1d9-88f9-46f8-96c6-04dd43180259" status: 200 len: 1368 microversion: 2.1 time: 0.170075 Aug 11 11:14:00.430137 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 585/1154] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:14:00 2022] GET /compute/v2.1/servers/1fbce1d9-88f9-46f8-96c6-04dd43180259 => generated 1368 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:14:01.437907 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-56a473a1-190c-495b-83c2-0352502c4473 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:14:01.438792 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-56a473a1-190c-495b-83c2-0352502c4473 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: 1fbce1d9-88f9-46f8-96c6-04dd43180259] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:14:01.452378 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-56a473a1-190c-495b-83c2-0352502c4473 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:14:01.452848 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-56a473a1-190c-495b-83c2-0352502c4473 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:14:01.453264 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-56a473a1-190c-495b-83c2-0352502c4473 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:14:01.453966 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-56a473a1-190c-495b-83c2-0352502c4473 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:14:01.454414 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-56a473a1-190c-495b-83c2-0352502c4473 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:14:01.454840 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-56a473a1-190c-495b-83c2-0352502c4473 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:14:01.603474 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-56a473a1-190c-495b-83c2-0352502c4473 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08d81bcd5a4f43ce8b4839ee15cb163b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56bd2a662e34a6395117027b5c28c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:14:01.614125 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-56a473a1-190c-495b-83c2-0352502c4473 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/1fbce1d9-88f9-46f8-96c6-04dd43180259" status: 200 len: 1368 microversion: 2.1 time: 0.180734 Aug 11 11:14:01.627184 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 570/1155] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:14:01 2022] GET /compute/v2.1/servers/1fbce1d9-88f9-46f8-96c6-04dd43180259 => generated 1368 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:14:02.634787 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-3df44e31-022f-49b8-a61e-5bcc282b6109 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:14:02.635524 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-3df44e31-022f-49b8-a61e-5bcc282b6109 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: 1fbce1d9-88f9-46f8-96c6-04dd43180259] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:14:02.643931 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3df44e31-022f-49b8-a61e-5bcc282b6109 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:14:02.644519 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3df44e31-022f-49b8-a61e-5bcc282b6109 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:14:02.645016 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3df44e31-022f-49b8-a61e-5bcc282b6109 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:14:02.645931 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3df44e31-022f-49b8-a61e-5bcc282b6109 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:14:02.646454 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3df44e31-022f-49b8-a61e-5bcc282b6109 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:14:02.646943 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3df44e31-022f-49b8-a61e-5bcc282b6109 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:14:02.795538 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-3df44e31-022f-49b8-a61e-5bcc282b6109 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08d81bcd5a4f43ce8b4839ee15cb163b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56bd2a662e34a6395117027b5c28c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:14:02.804444 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-3df44e31-022f-49b8-a61e-5bcc282b6109 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/1fbce1d9-88f9-46f8-96c6-04dd43180259" status: 200 len: 1368 microversion: 2.1 time: 0.173405 Aug 11 11:14:02.805495 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 586/1156] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:14:02 2022] GET /compute/v2.1/servers/1fbce1d9-88f9-46f8-96c6-04dd43180259 => generated 1368 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:14:03.829136 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-d30ad365-61ad-40c3-bec8-8aecec4b7619 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:14:03.829701 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-d30ad365-61ad-40c3-bec8-8aecec4b7619 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: 1fbce1d9-88f9-46f8-96c6-04dd43180259] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:14:03.832145 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell0:SELECT=6 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:14:03.832804 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:14:03.837408 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d30ad365-61ad-40c3-bec8-8aecec4b7619 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:14:03.837904 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d30ad365-61ad-40c3-bec8-8aecec4b7619 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:14:03.838333 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d30ad365-61ad-40c3-bec8-8aecec4b7619 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:14:03.839019 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d30ad365-61ad-40c3-bec8-8aecec4b7619 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:14:03.839461 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d30ad365-61ad-40c3-bec8-8aecec4b7619 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:14:03.839906 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-d30ad365-61ad-40c3-bec8-8aecec4b7619 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:14:03.980223 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-d30ad365-61ad-40c3-bec8-8aecec4b7619 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08d81bcd5a4f43ce8b4839ee15cb163b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56bd2a662e34a6395117027b5c28c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:14:03.992877 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-d30ad365-61ad-40c3-bec8-8aecec4b7619 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/1fbce1d9-88f9-46f8-96c6-04dd43180259" status: 200 len: 1368 microversion: 2.1 time: 0.168094 Aug 11 11:14:03.999960 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 571/1157] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:14:03 2022] GET /compute/v2.1/servers/1fbce1d9-88f9-46f8-96c6-04dd43180259 => generated 1368 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:14:05.015115 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-3264b9a7-ffc4-482b-9f55-50947422ed0f tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:14:05.015982 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-3264b9a7-ffc4-482b-9f55-50947422ed0f tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: 1fbce1d9-88f9-46f8-96c6-04dd43180259] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:14:05.021541 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell0:SELECT=2 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:14:05.022205 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell0:SELECT=6 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:14:05.024834 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3264b9a7-ffc4-482b-9f55-50947422ed0f tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:14:05.025713 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3264b9a7-ffc4-482b-9f55-50947422ed0f tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:14:05.026159 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3264b9a7-ffc4-482b-9f55-50947422ed0f tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:14:05.029647 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3264b9a7-ffc4-482b-9f55-50947422ed0f tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:14:05.029647 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3264b9a7-ffc4-482b-9f55-50947422ed0f tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:14:05.029647 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3264b9a7-ffc4-482b-9f55-50947422ed0f tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:14:05.189373 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-3264b9a7-ffc4-482b-9f55-50947422ed0f tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08d81bcd5a4f43ce8b4839ee15cb163b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56bd2a662e34a6395117027b5c28c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:14:05.198591 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-3264b9a7-ffc4-482b-9f55-50947422ed0f tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/1fbce1d9-88f9-46f8-96c6-04dd43180259" status: 200 len: 1368 microversion: 2.1 time: 0.187638 Aug 11 11:14:05.212517 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 587/1158] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:14:05 2022] GET /compute/v2.1/servers/1fbce1d9-88f9-46f8-96c6-04dd43180259 => generated 1368 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:14:05.516898 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-fbd9aea7-7dab-46ce-b662-7eacbbbe3562 req-bb14b92e-f7d0-4a54-aea1-c36b03df01e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fbce1d9-88f9-46f8-96c6-04dd43180259", "name": "network-vif-plugged", "status": "completed", "tag": "d14b79b9-819d-4c3b-b0a3-d9a3809d0ae8"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:14:05.536847 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-fbd9aea7-7dab-46ce-b662-7eacbbbe3562 req-bb14b92e-f7d0-4a54-aea1-c36b03df01e8 service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:14:05.540173 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-fbd9aea7-7dab-46ce-b662-7eacbbbe3562 req-bb14b92e-f7d0-4a54-aea1-c36b03df01e8 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:14:05.541200 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-fbd9aea7-7dab-46ce-b662-7eacbbbe3562 req-bb14b92e-f7d0-4a54-aea1-c36b03df01e8 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:14:05.555892 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-fbd9aea7-7dab-46ce-b662-7eacbbbe3562 req-bb14b92e-f7d0-4a54-aea1-c36b03df01e8 service nova] Creating event network-vif-plugged:d14b79b9-819d-4c3b-b0a3-d9a3809d0ae8 for instance 1fbce1d9-88f9-46f8-96c6-04dd43180259 on hv-cinder-82002 Aug 11 11:14:05.561222 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-fbd9aea7-7dab-46ce-b662-7eacbbbe3562 req-bb14b92e-f7d0-4a54-aea1-c36b03df01e8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050150 Aug 11 11:14:05.561812 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 572/1159] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:14:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:14:06.223073 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-36b4ca38-9b4a-4be8-9da2-7a59d08bf38e tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:14:06.223891 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-36b4ca38-9b4a-4be8-9da2-7a59d08bf38e tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: 1fbce1d9-88f9-46f8-96c6-04dd43180259] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:14:06.231075 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-36b4ca38-9b4a-4be8-9da2-7a59d08bf38e tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:14:06.231920 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-36b4ca38-9b4a-4be8-9da2-7a59d08bf38e tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:14:06.232523 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-36b4ca38-9b4a-4be8-9da2-7a59d08bf38e tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:14:06.233857 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-36b4ca38-9b4a-4be8-9da2-7a59d08bf38e tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:14:06.235175 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-36b4ca38-9b4a-4be8-9da2-7a59d08bf38e tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:14:06.236123 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-36b4ca38-9b4a-4be8-9da2-7a59d08bf38e tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:14:06.393101 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-36b4ca38-9b4a-4be8-9da2-7a59d08bf38e tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08d81bcd5a4f43ce8b4839ee15cb163b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56bd2a662e34a6395117027b5c28c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:14:06.400871 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-36b4ca38-9b4a-4be8-9da2-7a59d08bf38e tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/1fbce1d9-88f9-46f8-96c6-04dd43180259" status: 200 len: 1368 microversion: 2.1 time: 0.182754 Aug 11 11:14:06.401455 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 588/1160] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:14:06 2022] GET /compute/v2.1/servers/1fbce1d9-88f9-46f8-96c6-04dd43180259 => generated 1368 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:14:07.423387 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-41a8d35e-c360-4ecf-a2c2-0882e99cb0ca tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:14:07.424315 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-41a8d35e-c360-4ecf-a2c2-0882e99cb0ca tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: 1fbce1d9-88f9-46f8-96c6-04dd43180259] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:14:07.432119 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-41a8d35e-c360-4ecf-a2c2-0882e99cb0ca tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:14:07.432834 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-41a8d35e-c360-4ecf-a2c2-0882e99cb0ca tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:14:07.433448 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-41a8d35e-c360-4ecf-a2c2-0882e99cb0ca tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:14:07.434303 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-41a8d35e-c360-4ecf-a2c2-0882e99cb0ca tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:14:07.434797 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-41a8d35e-c360-4ecf-a2c2-0882e99cb0ca tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:14:07.435277 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-41a8d35e-c360-4ecf-a2c2-0882e99cb0ca tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:14:07.619138 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-41a8d35e-c360-4ecf-a2c2-0882e99cb0ca tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08d81bcd5a4f43ce8b4839ee15cb163b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56bd2a662e34a6395117027b5c28c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:14:07.627439 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-41a8d35e-c360-4ecf-a2c2-0882e99cb0ca tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/1fbce1d9-88f9-46f8-96c6-04dd43180259" status: 200 len: 1368 microversion: 2.1 time: 0.208966 Aug 11 11:14:07.628436 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 573/1161] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:14:07 2022] GET /compute/v2.1/servers/1fbce1d9-88f9-46f8-96c6-04dd43180259 => generated 1368 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:14:08.654718 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-48b5aac9-4229-4f51-bc71-cb24467e50a4 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:14:08.655304 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-48b5aac9-4229-4f51-bc71-cb24467e50a4 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: 1fbce1d9-88f9-46f8-96c6-04dd43180259] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:14:08.664235 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-48b5aac9-4229-4f51-bc71-cb24467e50a4 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:14:08.665549 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-48b5aac9-4229-4f51-bc71-cb24467e50a4 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:14:08.666183 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-48b5aac9-4229-4f51-bc71-cb24467e50a4 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:14:08.666922 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-48b5aac9-4229-4f51-bc71-cb24467e50a4 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:14:08.667533 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-48b5aac9-4229-4f51-bc71-cb24467e50a4 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:14:08.668766 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-48b5aac9-4229-4f51-bc71-cb24467e50a4 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:14:08.807275 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-48b5aac9-4229-4f51-bc71-cb24467e50a4 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08d81bcd5a4f43ce8b4839ee15cb163b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56bd2a662e34a6395117027b5c28c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:14:08.816338 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-48b5aac9-4229-4f51-bc71-cb24467e50a4 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/1fbce1d9-88f9-46f8-96c6-04dd43180259" status: 200 len: 1558 microversion: 2.1 time: 0.165500 Aug 11 11:14:08.817271 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 589/1162] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:14:08 2022] GET /compute/v2.1/servers/1fbce1d9-88f9-46f8-96c6-04dd43180259 => generated 1558 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:14:08.838139 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-51d5ec17-517a-4550-9590-0263e3b8519b tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:14:08.838708 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-51d5ec17-517a-4550-9590-0263e3b8519b tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: 1fbce1d9-88f9-46f8-96c6-04dd43180259] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:14:08.845623 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-51d5ec17-517a-4550-9590-0263e3b8519b tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:14:08.846179 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-51d5ec17-517a-4550-9590-0263e3b8519b tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:14:08.846682 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-51d5ec17-517a-4550-9590-0263e3b8519b tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:14:08.847447 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-51d5ec17-517a-4550-9590-0263e3b8519b tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:14:08.848011 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-51d5ec17-517a-4550-9590-0263e3b8519b tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:14:08.848543 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-51d5ec17-517a-4550-9590-0263e3b8519b tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:14:08.930477 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-51d5ec17-517a-4550-9590-0263e3b8519b tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/1fbce1d9-88f9-46f8-96c6-04dd43180259/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096500 Aug 11 11:14:08.931065 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 574/1163] 10.222.0.48 () {58 vars in 1275 bytes} [Thu Aug 11 11:14:08 2022] GET /compute/v2.1/servers/1fbce1d9-88f9-46f8-96c6-04dd43180259/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:14:10.005928 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-3058c68c-a066-47b5-a92f-1776087bde8e req-6b42bd47-c637-4542-8b3c-49880381fd7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fbce1d9-88f9-46f8-96c6-04dd43180259", "tag": "d14b79b9-819d-4c3b-b0a3-d9a3809d0ae8"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:14:10.017074 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-3058c68c-a066-47b5-a92f-1776087bde8e req-6b42bd47-c637-4542-8b3c-49880381fd7d service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:14:10.017551 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-3058c68c-a066-47b5-a92f-1776087bde8e req-6b42bd47-c637-4542-8b3c-49880381fd7d service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:14:10.017976 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-3058c68c-a066-47b5-a92f-1776087bde8e req-6b42bd47-c637-4542-8b3c-49880381fd7d service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:14:10.029722 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-3058c68c-a066-47b5-a92f-1776087bde8e req-6b42bd47-c637-4542-8b3c-49880381fd7d service nova] Creating event network-changed:d14b79b9-819d-4c3b-b0a3-d9a3809d0ae8 for instance 1fbce1d9-88f9-46f8-96c6-04dd43180259 on hv-cinder-82002 Aug 11 11:14:10.034972 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-3058c68c-a066-47b5-a92f-1776087bde8e req-6b42bd47-c637-4542-8b3c-49880381fd7d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033220 Aug 11 11:14:10.035633 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 590/1164] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:14:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:14:24.277928 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_api:SELECT=7 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:14:24.278769 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell1:SELECT=45 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:14:24.282684 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-7431b59f-7866-44d6-a63a-4dfe8c1e895b tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1090533962", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-614059539", "security_groups": [{"name": "tempest-secgroup-smoke-879638545"}], "block_device_mapping_v2": [{"uuid": "7fdbd1ea-4eb5-466d-b1e2-7e053d78063e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1386703a-61b7-4e13-98b7-ce04b934949c"}]}} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:14:24.398669 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.network.neutron [None req-7431b59f-7866-44d6-a63a-4dfe8c1e895b tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] validate_networks() for [('1386703a-61b7-4e13-98b7-ce04b934949c', None, None, None, None, None)] {{(pid=121231) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 11 11:14:24.917600 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-7431b59f-7866-44d6-a63a-4dfe8c1e895b tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Flavor limits 0:0:0 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 11 11:14:24.918025 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-7431b59f-7866-44d6-a63a-4dfe8c1e895b tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Image limits 0:0:0 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 11 11:14:24.918506 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-7431b59f-7866-44d6-a63a-4dfe8c1e895b tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Flavor pref 0:0:0 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 11 11:14:24.918914 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-7431b59f-7866-44d6-a63a-4dfe8c1e895b tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Image pref 0:0:0 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 11 11:14:24.919323 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.virt.hardware [None req-7431b59f-7866-44d6-a63a-4dfe8c1e895b tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121231) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 11 11:14:24.928054 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7431b59f-7866-44d6-a63a-4dfe8c1e895b tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:14:24.928541 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7431b59f-7866-44d6-a63a-4dfe8c1e895b tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:14:24.928974 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7431b59f-7866-44d6-a63a-4dfe8c1e895b tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:14:24.929697 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7431b59f-7866-44d6-a63a-4dfe8c1e895b tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:14:24.930150 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7431b59f-7866-44d6-a63a-4dfe8c1e895b tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:14:24.930575 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7431b59f-7866-44d6-a63a-4dfe8c1e895b tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:14:24.947737 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.quota [None req-7431b59f-7866-44d6-a63a-4dfe8c1e895b tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Getting quotas for project b1d394882f294c6283721bcc6f8ff04d. Resources: {'ram', 'cores', 'instances'} {{(pid=121231) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 11:14:24.952491 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.quota [None req-7431b59f-7866-44d6-a63a-4dfe8c1e895b tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Getting quotas for user 2a9dbe3b7fdd482681b6ab94c26f4e71 and project b1d394882f294c6283721bcc6f8ff04d. Resources: {'ram', 'cores', 'instances'} {{(pid=121231) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 11:14:25.009408 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-7431b59f-7866-44d6-a63a-4dfe8c1e895b tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Going to run 1 instances... {{(pid=121231) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 11 11:14:25.012286 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-7431b59f-7866-44d6-a63a-4dfe8c1e895b tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: 6fba9bf9-84fb-45fd-b07c-9b9d796c486a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7fdbd1ea-4eb5-466d-b1e2-7e053d78063e',volume_size=None,volume_type=None)] {{(pid=121231) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 11 11:14:25.473642 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-7431b59f-7866-44d6-a63a-4dfe8c1e895b tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.197602 Aug 11 11:14:25.474656 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 575/1165] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Aug 11 11:14:24 2022] POST /compute/v2.1/servers => generated 405 bytes in 1199 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 11 11:14:25.483682 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_api:SELECT=11 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:14:25.491342 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:14:25.491342 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-a8d3a019-3598-4df2-b921-a055f09718b8 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:14:25.491859 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-a8d3a019-3598-4df2-b921-a055f09718b8 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: 6fba9bf9-84fb-45fd-b07c-9b9d796c486a] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:14:25.556282 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-a8d3a019-3598-4df2-b921-a055f09718b8 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9dbe3b7fdd482681b6ab94c26f4e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d394882f294c6283721bcc6f8ff04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:14:25.564677 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-a8d3a019-3598-4df2-b921-a055f09718b8 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "GET /compute/v2.1/servers/6fba9bf9-84fb-45fd-b07c-9b9d796c486a" status: 200 len: 1094 microversion: 2.1 time: 0.082597 Aug 11 11:14:25.576109 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 591/1166] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:14:25 2022] GET /compute/v2.1/servers/6fba9bf9-84fb-45fd-b07c-9b9d796c486a => generated 1094 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:14:26.587349 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-102b6b05-649e-4869-b399-bac8628fb431 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:14:26.587933 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-102b6b05-649e-4869-b399-bac8628fb431 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: 6fba9bf9-84fb-45fd-b07c-9b9d796c486a] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:14:26.595360 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-102b6b05-649e-4869-b399-bac8628fb431 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:14:26.595949 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-102b6b05-649e-4869-b399-bac8628fb431 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:14:26.596396 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-102b6b05-649e-4869-b399-bac8628fb431 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:14:26.597137 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-102b6b05-649e-4869-b399-bac8628fb431 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:14:26.597595 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-102b6b05-649e-4869-b399-bac8628fb431 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:14:26.598198 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-102b6b05-649e-4869-b399-bac8628fb431 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:14:26.660680 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-102b6b05-649e-4869-b399-bac8628fb431 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9dbe3b7fdd482681b6ab94c26f4e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d394882f294c6283721bcc6f8ff04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:14:26.668490 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-102b6b05-649e-4869-b399-bac8628fb431 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "GET /compute/v2.1/servers/6fba9bf9-84fb-45fd-b07c-9b9d796c486a" status: 200 len: 1144 microversion: 2.1 time: 0.085623 Aug 11 11:14:26.669074 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 576/1167] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:14:26 2022] GET /compute/v2.1/servers/6fba9bf9-84fb-45fd-b07c-9b9d796c486a => generated 1144 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:14:27.689764 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-bfb765f8-b9f1-4394-9fa9-8a9472906ecf tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:14:27.690390 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-bfb765f8-b9f1-4394-9fa9-8a9472906ecf tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: 6fba9bf9-84fb-45fd-b07c-9b9d796c486a] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:14:27.698237 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bfb765f8-b9f1-4394-9fa9-8a9472906ecf tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:14:27.698713 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bfb765f8-b9f1-4394-9fa9-8a9472906ecf tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:14:27.699142 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bfb765f8-b9f1-4394-9fa9-8a9472906ecf tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:14:27.699903 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bfb765f8-b9f1-4394-9fa9-8a9472906ecf tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:14:27.700347 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bfb765f8-b9f1-4394-9fa9-8a9472906ecf tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:14:27.701351 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-bfb765f8-b9f1-4394-9fa9-8a9472906ecf tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:14:27.766929 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-bfb765f8-b9f1-4394-9fa9-8a9472906ecf tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9dbe3b7fdd482681b6ab94c26f4e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d394882f294c6283721bcc6f8ff04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:14:27.774375 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-bfb765f8-b9f1-4394-9fa9-8a9472906ecf tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "GET /compute/v2.1/servers/6fba9bf9-84fb-45fd-b07c-9b9d796c486a" status: 200 len: 1192 microversion: 2.1 time: 0.089080 Aug 11 11:14:27.774933 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 592/1168] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:14:27 2022] GET /compute/v2.1/servers/6fba9bf9-84fb-45fd-b07c-9b9d796c486a => generated 1192 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:14:28.794608 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-18238345-212c-4d98-95bd-568693ea4621 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:14:28.795342 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-18238345-212c-4d98-95bd-568693ea4621 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: 6fba9bf9-84fb-45fd-b07c-9b9d796c486a] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:14:28.801628 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-18238345-212c-4d98-95bd-568693ea4621 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:14:28.803982 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-18238345-212c-4d98-95bd-568693ea4621 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:14:28.803982 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-18238345-212c-4d98-95bd-568693ea4621 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:14:28.803982 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-18238345-212c-4d98-95bd-568693ea4621 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:14:28.803982 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-18238345-212c-4d98-95bd-568693ea4621 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:14:28.804373 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-18238345-212c-4d98-95bd-568693ea4621 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:14:28.867726 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-18238345-212c-4d98-95bd-568693ea4621 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9dbe3b7fdd482681b6ab94c26f4e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d394882f294c6283721bcc6f8ff04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:14:28.875523 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-18238345-212c-4d98-95bd-568693ea4621 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "GET /compute/v2.1/servers/6fba9bf9-84fb-45fd-b07c-9b9d796c486a" status: 200 len: 1210 microversion: 2.1 time: 0.084831 Aug 11 11:14:28.884748 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 577/1169] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:14:28 2022] GET /compute/v2.1/servers/6fba9bf9-84fb-45fd-b07c-9b9d796c486a => generated 1210 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:14:29.896243 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-f743af21-1c19-4dec-a17b-0df8d3f3d5ea tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:14:29.896998 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-f743af21-1c19-4dec-a17b-0df8d3f3d5ea tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: 6fba9bf9-84fb-45fd-b07c-9b9d796c486a] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:14:29.904182 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f743af21-1c19-4dec-a17b-0df8d3f3d5ea tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:14:29.904673 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f743af21-1c19-4dec-a17b-0df8d3f3d5ea tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:14:29.905112 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f743af21-1c19-4dec-a17b-0df8d3f3d5ea tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:14:29.906364 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f743af21-1c19-4dec-a17b-0df8d3f3d5ea tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:14:29.906808 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f743af21-1c19-4dec-a17b-0df8d3f3d5ea tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:14:29.907268 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-f743af21-1c19-4dec-a17b-0df8d3f3d5ea tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:14:30.044133 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-f743af21-1c19-4dec-a17b-0df8d3f3d5ea tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9dbe3b7fdd482681b6ab94c26f4e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d394882f294c6283721bcc6f8ff04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:14:30.052336 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-f743af21-1c19-4dec-a17b-0df8d3f3d5ea tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "GET /compute/v2.1/servers/6fba9bf9-84fb-45fd-b07c-9b9d796c486a" status: 200 len: 1277 microversion: 2.1 time: 0.160003 Aug 11 11:14:30.052908 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 593/1170] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:14:29 2022] GET /compute/v2.1/servers/6fba9bf9-84fb-45fd-b07c-9b9d796c486a => generated 1277 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:14:30.409916 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-f09ad107-c535-43ff-bfc0-f8881e0366fd req-52d511ef-f443-4cb3-9ddb-e69c513837a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fba9bf9-84fb-45fd-b07c-9b9d796c486a", "tag": "9f18d0a0-0718-48ba-a282-185e93527632"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:14:30.419198 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-f09ad107-c535-43ff-bfc0-f8881e0366fd req-52d511ef-f443-4cb3-9ddb-e69c513837a5 service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:14:30.419738 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-f09ad107-c535-43ff-bfc0-f8881e0366fd req-52d511ef-f443-4cb3-9ddb-e69c513837a5 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:14:30.420183 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-f09ad107-c535-43ff-bfc0-f8881e0366fd req-52d511ef-f443-4cb3-9ddb-e69c513837a5 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:14:30.431802 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-f09ad107-c535-43ff-bfc0-f8881e0366fd req-52d511ef-f443-4cb3-9ddb-e69c513837a5 service nova] Creating event network-changed:9f18d0a0-0718-48ba-a282-185e93527632 for instance 6fba9bf9-84fb-45fd-b07c-9b9d796c486a on hv-cinder-82002 Aug 11 11:14:30.436750 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-f09ad107-c535-43ff-bfc0-f8881e0366fd req-52d511ef-f443-4cb3-9ddb-e69c513837a5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151505 Aug 11 11:14:30.440294 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 578/1171] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:14:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:14:31.072730 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-d1296ec0-8555-48c9-9949-bf8832c906b5 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:14:31.073331 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-d1296ec0-8555-48c9-9949-bf8832c906b5 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: 6fba9bf9-84fb-45fd-b07c-9b9d796c486a] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:14:31.079688 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d1296ec0-8555-48c9-9949-bf8832c906b5 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:14:31.080196 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d1296ec0-8555-48c9-9949-bf8832c906b5 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:14:31.080625 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d1296ec0-8555-48c9-9949-bf8832c906b5 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:14:31.081301 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d1296ec0-8555-48c9-9949-bf8832c906b5 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:14:31.081746 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d1296ec0-8555-48c9-9949-bf8832c906b5 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:14:31.082169 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-d1296ec0-8555-48c9-9949-bf8832c906b5 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:14:31.213323 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-d1296ec0-8555-48c9-9949-bf8832c906b5 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9dbe3b7fdd482681b6ab94c26f4e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d394882f294c6283721bcc6f8ff04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:14:31.220889 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-d1296ec0-8555-48c9-9949-bf8832c906b5 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "GET /compute/v2.1/servers/6fba9bf9-84fb-45fd-b07c-9b9d796c486a" status: 200 len: 1265 microversion: 2.1 time: 0.151994 Aug 11 11:14:31.221479 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 594/1172] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:14:31 2022] GET /compute/v2.1/servers/6fba9bf9-84fb-45fd-b07c-9b9d796c486a => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:14:32.242868 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-24ca76c9-35f5-4e4f-bc9c-f7e8aac278b8 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:14:32.243558 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-24ca76c9-35f5-4e4f-bc9c-f7e8aac278b8 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: 6fba9bf9-84fb-45fd-b07c-9b9d796c486a] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:14:32.249726 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-24ca76c9-35f5-4e4f-bc9c-f7e8aac278b8 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:14:32.250205 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-24ca76c9-35f5-4e4f-bc9c-f7e8aac278b8 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:14:32.251124 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-24ca76c9-35f5-4e4f-bc9c-f7e8aac278b8 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:14:32.251826 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-24ca76c9-35f5-4e4f-bc9c-f7e8aac278b8 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:14:32.252274 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-24ca76c9-35f5-4e4f-bc9c-f7e8aac278b8 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:14:32.252692 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-24ca76c9-35f5-4e4f-bc9c-f7e8aac278b8 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:14:32.381200 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-24ca76c9-35f5-4e4f-bc9c-f7e8aac278b8 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9dbe3b7fdd482681b6ab94c26f4e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d394882f294c6283721bcc6f8ff04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:14:32.388556 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-24ca76c9-35f5-4e4f-bc9c-f7e8aac278b8 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "GET /compute/v2.1/servers/6fba9bf9-84fb-45fd-b07c-9b9d796c486a" status: 200 len: 1265 microversion: 2.1 time: 0.150331 Aug 11 11:14:32.390001 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 579/1173] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:14:32 2022] GET /compute/v2.1/servers/6fba9bf9-84fb-45fd-b07c-9b9d796c486a => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:14:33.410288 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-7da1d07a-f45e-4457-b9e5-3fe9e34d93ac tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:14:33.410905 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-7da1d07a-f45e-4457-b9e5-3fe9e34d93ac tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: 6fba9bf9-84fb-45fd-b07c-9b9d796c486a] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:14:33.417489 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7da1d07a-f45e-4457-b9e5-3fe9e34d93ac tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:14:33.417966 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7da1d07a-f45e-4457-b9e5-3fe9e34d93ac tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:14:33.418394 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7da1d07a-f45e-4457-b9e5-3fe9e34d93ac tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:14:33.419079 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7da1d07a-f45e-4457-b9e5-3fe9e34d93ac tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:14:33.419537 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7da1d07a-f45e-4457-b9e5-3fe9e34d93ac tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:14:33.420042 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7da1d07a-f45e-4457-b9e5-3fe9e34d93ac tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:14:33.562408 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-7da1d07a-f45e-4457-b9e5-3fe9e34d93ac tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9dbe3b7fdd482681b6ab94c26f4e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d394882f294c6283721bcc6f8ff04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:14:33.565683 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-7da1d07a-f45e-4457-b9e5-3fe9e34d93ac tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "GET /compute/v2.1/servers/6fba9bf9-84fb-45fd-b07c-9b9d796c486a" status: 200 len: 1265 microversion: 2.1 time: 0.159965 Aug 11 11:14:33.566248 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 595/1174] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:14:33 2022] GET /compute/v2.1/servers/6fba9bf9-84fb-45fd-b07c-9b9d796c486a => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:14:34.586432 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-be7f906a-f85a-49b8-910a-cc679f3418a2 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:14:34.587042 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-be7f906a-f85a-49b8-910a-cc679f3418a2 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: 6fba9bf9-84fb-45fd-b07c-9b9d796c486a] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:14:34.593645 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-be7f906a-f85a-49b8-910a-cc679f3418a2 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:14:34.594127 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-be7f906a-f85a-49b8-910a-cc679f3418a2 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:14:34.594562 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-be7f906a-f85a-49b8-910a-cc679f3418a2 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:14:34.595252 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-be7f906a-f85a-49b8-910a-cc679f3418a2 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:14:34.595704 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-be7f906a-f85a-49b8-910a-cc679f3418a2 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:14:34.596202 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-be7f906a-f85a-49b8-910a-cc679f3418a2 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:14:34.722805 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-be7f906a-f85a-49b8-910a-cc679f3418a2 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9dbe3b7fdd482681b6ab94c26f4e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d394882f294c6283721bcc6f8ff04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:14:34.730282 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-be7f906a-f85a-49b8-910a-cc679f3418a2 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "GET /compute/v2.1/servers/6fba9bf9-84fb-45fd-b07c-9b9d796c486a" status: 200 len: 1265 microversion: 2.1 time: 0.148098 Aug 11 11:14:34.730844 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 580/1175] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:14:34 2022] GET /compute/v2.1/servers/6fba9bf9-84fb-45fd-b07c-9b9d796c486a => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:14:35.751809 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-54172666-9501-419a-b0e3-fed2099c82e0 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:14:35.752414 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-54172666-9501-419a-b0e3-fed2099c82e0 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: 6fba9bf9-84fb-45fd-b07c-9b9d796c486a] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:14:35.754720 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell0:SELECT=2 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:14:35.759685 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-54172666-9501-419a-b0e3-fed2099c82e0 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:14:35.760193 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-54172666-9501-419a-b0e3-fed2099c82e0 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:14:35.760621 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-54172666-9501-419a-b0e3-fed2099c82e0 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:14:35.761296 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-54172666-9501-419a-b0e3-fed2099c82e0 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:14:35.761740 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-54172666-9501-419a-b0e3-fed2099c82e0 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:14:35.762165 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-54172666-9501-419a-b0e3-fed2099c82e0 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:14:35.894260 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-54172666-9501-419a-b0e3-fed2099c82e0 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9dbe3b7fdd482681b6ab94c26f4e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d394882f294c6283721bcc6f8ff04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:14:35.901728 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-54172666-9501-419a-b0e3-fed2099c82e0 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "GET /compute/v2.1/servers/6fba9bf9-84fb-45fd-b07c-9b9d796c486a" status: 200 len: 1265 microversion: 2.1 time: 0.153873 Aug 11 11:14:35.902291 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 596/1176] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:14:35 2022] GET /compute/v2.1/servers/6fba9bf9-84fb-45fd-b07c-9b9d796c486a => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:14:36.922646 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-346d3b2b-e80a-4bb3-89f7-58088fd38e84 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:14:36.923256 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-346d3b2b-e80a-4bb3-89f7-58088fd38e84 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: 6fba9bf9-84fb-45fd-b07c-9b9d796c486a] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:14:36.925220 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell0:SELECT=2 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:14:36.925874 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell0:SELECT=6 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:14:36.931127 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-346d3b2b-e80a-4bb3-89f7-58088fd38e84 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:14:36.931607 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-346d3b2b-e80a-4bb3-89f7-58088fd38e84 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:14:36.932079 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-346d3b2b-e80a-4bb3-89f7-58088fd38e84 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:14:36.932769 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-346d3b2b-e80a-4bb3-89f7-58088fd38e84 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:14:36.933218 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-346d3b2b-e80a-4bb3-89f7-58088fd38e84 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:14:36.933637 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-346d3b2b-e80a-4bb3-89f7-58088fd38e84 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:14:37.066886 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-346d3b2b-e80a-4bb3-89f7-58088fd38e84 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9dbe3b7fdd482681b6ab94c26f4e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d394882f294c6283721bcc6f8ff04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:14:37.074296 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-346d3b2b-e80a-4bb3-89f7-58088fd38e84 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "GET /compute/v2.1/servers/6fba9bf9-84fb-45fd-b07c-9b9d796c486a" status: 200 len: 1265 microversion: 2.1 time: 0.155590 Aug 11 11:14:37.074874 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 581/1177] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:14:36 2022] GET /compute/v2.1/servers/6fba9bf9-84fb-45fd-b07c-9b9d796c486a => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:14:38.095571 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-7b4c1ecc-bdc6-4c35-81be-532a700e0780 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:14:38.096216 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-7b4c1ecc-bdc6-4c35-81be-532a700e0780 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: 6fba9bf9-84fb-45fd-b07c-9b9d796c486a] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:14:38.102896 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7b4c1ecc-bdc6-4c35-81be-532a700e0780 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:14:38.103382 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7b4c1ecc-bdc6-4c35-81be-532a700e0780 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:14:38.103856 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7b4c1ecc-bdc6-4c35-81be-532a700e0780 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:14:38.104546 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7b4c1ecc-bdc6-4c35-81be-532a700e0780 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:14:38.105004 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7b4c1ecc-bdc6-4c35-81be-532a700e0780 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:14:38.105438 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-7b4c1ecc-bdc6-4c35-81be-532a700e0780 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:14:38.233563 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-7b4c1ecc-bdc6-4c35-81be-532a700e0780 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9dbe3b7fdd482681b6ab94c26f4e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d394882f294c6283721bcc6f8ff04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:14:38.241206 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-7b4c1ecc-bdc6-4c35-81be-532a700e0780 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "GET /compute/v2.1/servers/6fba9bf9-84fb-45fd-b07c-9b9d796c486a" status: 200 len: 1265 microversion: 2.1 time: 0.149737 Aug 11 11:14:38.243421 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 597/1178] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:14:38 2022] GET /compute/v2.1/servers/6fba9bf9-84fb-45fd-b07c-9b9d796c486a => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:14:39.261885 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-15e57ec2-70a1-47a2-b164-b6a0dc79b717 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:14:39.262490 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-15e57ec2-70a1-47a2-b164-b6a0dc79b717 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: 6fba9bf9-84fb-45fd-b07c-9b9d796c486a] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:14:39.269154 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-15e57ec2-70a1-47a2-b164-b6a0dc79b717 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:14:39.269630 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-15e57ec2-70a1-47a2-b164-b6a0dc79b717 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:14:39.270059 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-15e57ec2-70a1-47a2-b164-b6a0dc79b717 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:14:39.270738 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-15e57ec2-70a1-47a2-b164-b6a0dc79b717 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:14:39.271182 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-15e57ec2-70a1-47a2-b164-b6a0dc79b717 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:14:39.271597 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-15e57ec2-70a1-47a2-b164-b6a0dc79b717 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:14:39.403305 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-15e57ec2-70a1-47a2-b164-b6a0dc79b717 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9dbe3b7fdd482681b6ab94c26f4e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d394882f294c6283721bcc6f8ff04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:14:39.410966 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-15e57ec2-70a1-47a2-b164-b6a0dc79b717 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "GET /compute/v2.1/servers/6fba9bf9-84fb-45fd-b07c-9b9d796c486a" status: 200 len: 1265 microversion: 2.1 time: 0.152910 Aug 11 11:14:39.411537 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 582/1179] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:14:39 2022] GET /compute/v2.1/servers/6fba9bf9-84fb-45fd-b07c-9b9d796c486a => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:14:40.431989 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-34f5dd71-ba49-42eb-b505-6ba16a8e1f8e tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:14:40.432627 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-34f5dd71-ba49-42eb-b505-6ba16a8e1f8e tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: 6fba9bf9-84fb-45fd-b07c-9b9d796c486a] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:14:40.439114 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-34f5dd71-ba49-42eb-b505-6ba16a8e1f8e tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:14:40.439629 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-34f5dd71-ba49-42eb-b505-6ba16a8e1f8e tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:14:40.440115 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-34f5dd71-ba49-42eb-b505-6ba16a8e1f8e tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:14:40.440794 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-34f5dd71-ba49-42eb-b505-6ba16a8e1f8e tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:14:40.441240 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-34f5dd71-ba49-42eb-b505-6ba16a8e1f8e tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:14:40.441656 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-34f5dd71-ba49-42eb-b505-6ba16a8e1f8e tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:14:40.568575 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-34f5dd71-ba49-42eb-b505-6ba16a8e1f8e tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9dbe3b7fdd482681b6ab94c26f4e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d394882f294c6283721bcc6f8ff04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:14:40.576099 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-34f5dd71-ba49-42eb-b505-6ba16a8e1f8e tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "GET /compute/v2.1/servers/6fba9bf9-84fb-45fd-b07c-9b9d796c486a" status: 200 len: 1265 microversion: 2.1 time: 0.147949 Aug 11 11:14:40.576592 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 598/1180] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:14:40 2022] GET /compute/v2.1/servers/6fba9bf9-84fb-45fd-b07c-9b9d796c486a => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:14:41.596777 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-f2b8a946-153c-457d-bf7c-a9bb1f020bbf tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:14:41.597387 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-f2b8a946-153c-457d-bf7c-a9bb1f020bbf tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: 6fba9bf9-84fb-45fd-b07c-9b9d796c486a] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:14:41.603552 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f2b8a946-153c-457d-bf7c-a9bb1f020bbf tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:14:41.604076 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f2b8a946-153c-457d-bf7c-a9bb1f020bbf tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:14:41.604508 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f2b8a946-153c-457d-bf7c-a9bb1f020bbf tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:14:41.605199 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f2b8a946-153c-457d-bf7c-a9bb1f020bbf tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:14:41.605647 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f2b8a946-153c-457d-bf7c-a9bb1f020bbf tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:14:41.606065 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f2b8a946-153c-457d-bf7c-a9bb1f020bbf tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:14:41.639918 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-a0e2c5a0-f116-463a-ac9c-a5b93fb5a845 req-e0a732c4-d4d6-43e3-8d25-c29ccf8d536b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fba9bf9-84fb-45fd-b07c-9b9d796c486a", "name": "network-vif-plugged", "status": "completed", "tag": "9f18d0a0-0718-48ba-a282-185e93527632"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:14:41.650198 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-a0e2c5a0-f116-463a-ac9c-a5b93fb5a845 req-e0a732c4-d4d6-43e3-8d25-c29ccf8d536b service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:14:41.650669 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-a0e2c5a0-f116-463a-ac9c-a5b93fb5a845 req-e0a732c4-d4d6-43e3-8d25-c29ccf8d536b service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:14:41.651089 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-a0e2c5a0-f116-463a-ac9c-a5b93fb5a845 req-e0a732c4-d4d6-43e3-8d25-c29ccf8d536b service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:14:41.662190 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-a0e2c5a0-f116-463a-ac9c-a5b93fb5a845 req-e0a732c4-d4d6-43e3-8d25-c29ccf8d536b service nova] Creating event network-vif-plugged:9f18d0a0-0718-48ba-a282-185e93527632 for instance 6fba9bf9-84fb-45fd-b07c-9b9d796c486a on hv-cinder-82002 Aug 11 11:14:41.667547 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-a0e2c5a0-f116-463a-ac9c-a5b93fb5a845 req-e0a732c4-d4d6-43e3-8d25-c29ccf8d536b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031385 Aug 11 11:14:41.668545 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 599/1181] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:14:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 11:14:41.754641 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-f2b8a946-153c-457d-bf7c-a9bb1f020bbf tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9dbe3b7fdd482681b6ab94c26f4e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d394882f294c6283721bcc6f8ff04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:14:41.763129 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-f2b8a946-153c-457d-bf7c-a9bb1f020bbf tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "GET /compute/v2.1/servers/6fba9bf9-84fb-45fd-b07c-9b9d796c486a" status: 200 len: 1265 microversion: 2.1 time: 0.170237 Aug 11 11:14:41.763703 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 583/1182] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:14:41 2022] GET /compute/v2.1/servers/6fba9bf9-84fb-45fd-b07c-9b9d796c486a => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:14:42.784391 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-6df45dce-e421-4004-8cf2-63e4bb8a3ba5 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:14:42.785091 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-6df45dce-e421-4004-8cf2-63e4bb8a3ba5 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: 6fba9bf9-84fb-45fd-b07c-9b9d796c486a] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:14:42.792351 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6df45dce-e421-4004-8cf2-63e4bb8a3ba5 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:14:42.792834 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6df45dce-e421-4004-8cf2-63e4bb8a3ba5 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:14:42.793277 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6df45dce-e421-4004-8cf2-63e4bb8a3ba5 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:14:42.793966 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6df45dce-e421-4004-8cf2-63e4bb8a3ba5 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:14:42.794419 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6df45dce-e421-4004-8cf2-63e4bb8a3ba5 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:14:42.794844 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6df45dce-e421-4004-8cf2-63e4bb8a3ba5 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:14:42.923915 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-6df45dce-e421-4004-8cf2-63e4bb8a3ba5 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9dbe3b7fdd482681b6ab94c26f4e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d394882f294c6283721bcc6f8ff04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:14:42.932064 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-6df45dce-e421-4004-8cf2-63e4bb8a3ba5 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "GET /compute/v2.1/servers/6fba9bf9-84fb-45fd-b07c-9b9d796c486a" status: 200 len: 1265 microversion: 2.1 time: 0.152219 Aug 11 11:14:42.932639 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 600/1183] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:14:42 2022] GET /compute/v2.1/servers/6fba9bf9-84fb-45fd-b07c-9b9d796c486a => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:14:43.952717 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-3196ca25-81f9-411b-83d9-58f7d8bed69d tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:14:43.953318 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-3196ca25-81f9-411b-83d9-58f7d8bed69d tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: 6fba9bf9-84fb-45fd-b07c-9b9d796c486a] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:14:43.959734 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3196ca25-81f9-411b-83d9-58f7d8bed69d tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:14:43.960236 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3196ca25-81f9-411b-83d9-58f7d8bed69d tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:14:43.960662 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3196ca25-81f9-411b-83d9-58f7d8bed69d tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:14:43.961335 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3196ca25-81f9-411b-83d9-58f7d8bed69d tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:14:43.961807 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3196ca25-81f9-411b-83d9-58f7d8bed69d tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:14:43.962221 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-3196ca25-81f9-411b-83d9-58f7d8bed69d tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:14:44.097464 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-3196ca25-81f9-411b-83d9-58f7d8bed69d tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9dbe3b7fdd482681b6ab94c26f4e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d394882f294c6283721bcc6f8ff04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:14:44.105116 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-3196ca25-81f9-411b-83d9-58f7d8bed69d tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "GET /compute/v2.1/servers/6fba9bf9-84fb-45fd-b07c-9b9d796c486a" status: 200 len: 1452 microversion: 2.1 time: 0.156235 Aug 11 11:14:44.118789 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 584/1184] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:14:43 2022] GET /compute/v2.1/servers/6fba9bf9-84fb-45fd-b07c-9b9d796c486a => generated 1452 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:14:44.125503 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-0ae675ec-d984-467d-a815-ed9a1411d814 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:14:44.126225 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-0ae675ec-d984-467d-a815-ed9a1411d814 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: 6fba9bf9-84fb-45fd-b07c-9b9d796c486a] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:14:44.133296 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0ae675ec-d984-467d-a815-ed9a1411d814 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:14:44.133782 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0ae675ec-d984-467d-a815-ed9a1411d814 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:14:44.134220 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0ae675ec-d984-467d-a815-ed9a1411d814 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:14:44.134911 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0ae675ec-d984-467d-a815-ed9a1411d814 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:14:44.135364 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0ae675ec-d984-467d-a815-ed9a1411d814 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:14:44.135838 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-0ae675ec-d984-467d-a815-ed9a1411d814 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:14:44.268321 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-0ae675ec-d984-467d-a815-ed9a1411d814 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9dbe3b7fdd482681b6ab94c26f4e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d394882f294c6283721bcc6f8ff04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:14:44.275747 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-0ae675ec-d984-467d-a815-ed9a1411d814 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "GET /compute/v2.1/servers/6fba9bf9-84fb-45fd-b07c-9b9d796c486a" status: 200 len: 1452 microversion: 2.1 time: 0.154147 Aug 11 11:14:44.276327 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 601/1185] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:14:44 2022] GET /compute/v2.1/servers/6fba9bf9-84fb-45fd-b07c-9b9d796c486a => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:14:46.135794 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-7e861a3c-b537-4e4c-97b0-8156040c8f56 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:14:46.141943 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-d7f5205c-2268-43a7-86b8-cc2012598ce4 req-9c5b09bf-2c70-43b5-811d-789da485dc0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c9f7edb-2175-4575-ac11-781015e25a57", "tag": "c6b87a06-7611-406e-8113-f1a3bada6e72"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:14:46.146795 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-7e861a3c-b537-4e4c-97b0-8156040c8f56 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] [instance: 9c9f7edb-2175-4575-ac11-781015e25a57] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:14:46.157414 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7e861a3c-b537-4e4c-97b0-8156040c8f56 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:14:46.157896 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-d7f5205c-2268-43a7-86b8-cc2012598ce4 req-9c5b09bf-2c70-43b5-811d-789da485dc0f service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:14:46.159018 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7e861a3c-b537-4e4c-97b0-8156040c8f56 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:14:46.159157 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-d7f5205c-2268-43a7-86b8-cc2012598ce4 req-9c5b09bf-2c70-43b5-811d-789da485dc0f service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:14:46.159905 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7e861a3c-b537-4e4c-97b0-8156040c8f56 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:14:46.160868 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7e861a3c-b537-4e4c-97b0-8156040c8f56 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:14:46.161013 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-d7f5205c-2268-43a7-86b8-cc2012598ce4 req-9c5b09bf-2c70-43b5-811d-789da485dc0f service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:14:46.161745 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7e861a3c-b537-4e4c-97b0-8156040c8f56 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:14:46.162409 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7e861a3c-b537-4e4c-97b0-8156040c8f56 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:14:46.178551 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-d7f5205c-2268-43a7-86b8-cc2012598ce4 req-9c5b09bf-2c70-43b5-811d-789da485dc0f service nova] Creating event network-changed:c6b87a06-7611-406e-8113-f1a3bada6e72 for instance 9c9f7edb-2175-4575-ac11-781015e25a57 on hv-cinder-82002 Aug 11 11:14:46.185206 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-d7f5205c-2268-43a7-86b8-cc2012598ce4 req-9c5b09bf-2c70-43b5-811d-789da485dc0f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047189 Aug 11 11:14:46.189133 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 602/1186] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:14:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:14:46.196659 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-7e861a3c-b537-4e4c-97b0-8156040c8f56 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] [instance: 9c9f7edb-2175-4575-ac11-781015e25a57] Going to try to terminate instance {{(pid=121231) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 11 11:14:46.591797 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-7e861a3c-b537-4e4c-97b0-8156040c8f56 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] 10.222.0.48 "DELETE /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57" status: 204 len: 0 microversion: 2.1 time: 0.460821 Aug 11 11:14:46.593043 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 585/1187] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Aug 11 11:14:46 2022] DELETE /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 11 11:14:46.604811 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-373f1e4d-7838-4254-83d3-9a9e04372f94 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:14:46.605720 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-373f1e4d-7838-4254-83d3-9a9e04372f94 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] [instance: 9c9f7edb-2175-4575-ac11-781015e25a57] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:14:46.613552 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-373f1e4d-7838-4254-83d3-9a9e04372f94 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:14:46.615460 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-373f1e4d-7838-4254-83d3-9a9e04372f94 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:14:46.615460 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-373f1e4d-7838-4254-83d3-9a9e04372f94 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:14:46.615460 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-373f1e4d-7838-4254-83d3-9a9e04372f94 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:14:46.616079 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-373f1e4d-7838-4254-83d3-9a9e04372f94 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:14:46.616609 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-373f1e4d-7838-4254-83d3-9a9e04372f94 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:14:46.616759 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-e956a286-3cc1-4324-a636-1a8541563557 req-a3900afb-0a91-4ce8-9883-8240903b236e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fba9bf9-84fb-45fd-b07c-9b9d796c486a", "tag": "9f18d0a0-0718-48ba-a282-185e93527632"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:14:46.629295 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-e956a286-3cc1-4324-a636-1a8541563557 req-a3900afb-0a91-4ce8-9883-8240903b236e service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:14:46.630119 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-e956a286-3cc1-4324-a636-1a8541563557 req-a3900afb-0a91-4ce8-9883-8240903b236e service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:14:46.630545 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-e956a286-3cc1-4324-a636-1a8541563557 req-a3900afb-0a91-4ce8-9883-8240903b236e service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:14:46.646729 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-e956a286-3cc1-4324-a636-1a8541563557 req-a3900afb-0a91-4ce8-9883-8240903b236e service nova] Creating event network-changed:9f18d0a0-0718-48ba-a282-185e93527632 for instance 6fba9bf9-84fb-45fd-b07c-9b9d796c486a on hv-cinder-82002 Aug 11 11:14:46.654590 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-e956a286-3cc1-4324-a636-1a8541563557 req-a3900afb-0a91-4ce8-9883-8240903b236e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139492 Aug 11 11:14:46.660141 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 603/1188] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:14:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:14:46.786524 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-373f1e4d-7838-4254-83d3-9a9e04372f94 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b2f7b56f6d94908bf00b3f21954776c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea40881648b4df393fc35c07d8f68dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:14:46.794614 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-373f1e4d-7838-4254-83d3-9a9e04372f94 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] 10.222.0.48 "GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57" status: 200 len: 1568 microversion: 2.1 time: 0.197044 Aug 11 11:14:46.795567 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 586/1189] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:14:46 2022] GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57 => generated 1568 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:14:47.817583 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-633fe059-7a0d-4314-99ec-14c036dc741b tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:14:47.818264 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-633fe059-7a0d-4314-99ec-14c036dc741b tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] [instance: 9c9f7edb-2175-4575-ac11-781015e25a57] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:14:47.824464 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-633fe059-7a0d-4314-99ec-14c036dc741b tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:14:47.824938 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-633fe059-7a0d-4314-99ec-14c036dc741b tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:14:47.825362 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-633fe059-7a0d-4314-99ec-14c036dc741b tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:14:47.826043 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-633fe059-7a0d-4314-99ec-14c036dc741b tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:14:47.826487 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-633fe059-7a0d-4314-99ec-14c036dc741b tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:14:47.826905 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-633fe059-7a0d-4314-99ec-14c036dc741b tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:14:47.992213 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-633fe059-7a0d-4314-99ec-14c036dc741b tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b2f7b56f6d94908bf00b3f21954776c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea40881648b4df393fc35c07d8f68dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:14:48.000441 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-633fe059-7a0d-4314-99ec-14c036dc741b tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] 10.222.0.48 "GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57" status: 200 len: 1568 microversion: 2.1 time: 0.187487 Aug 11 11:14:48.001004 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 604/1190] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:14:47 2022] GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57 => generated 1568 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:14:48.179809 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-a454f86e-88f3-46f9-b667-dc3dcf227c68 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:14:48.180453 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-a454f86e-88f3-46f9-b667-dc3dcf227c68 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: 1fbce1d9-88f9-46f8-96c6-04dd43180259] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:14:48.186757 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a454f86e-88f3-46f9-b667-dc3dcf227c68 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:14:48.187233 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a454f86e-88f3-46f9-b667-dc3dcf227c68 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:14:48.187663 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a454f86e-88f3-46f9-b667-dc3dcf227c68 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:14:48.188387 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a454f86e-88f3-46f9-b667-dc3dcf227c68 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:14:48.188889 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a454f86e-88f3-46f9-b667-dc3dcf227c68 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:14:48.189264 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-a454f86e-88f3-46f9-b667-dc3dcf227c68 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:14:48.211982 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-a454f86e-88f3-46f9-b667-dc3dcf227c68 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/1fbce1d9-88f9-46f8-96c6-04dd43180259/ips" status: 200 len: 150 microversion: 2.1 time: 0.141001 Aug 11 11:14:48.212536 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 587/1191] 10.222.0.48 () {58 vars in 1248 bytes} [Thu Aug 11 11:14:48 2022] GET /compute/v2.1/servers/1fbce1d9-88f9-46f8-96c6-04dd43180259/ips => generated 150 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:14:48.989976 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-3974aff8-2ac0-47c1-9ac9-bd8dd45ef2ed req-cc5d3bd5-ec26-4213-9787-7a20b9a0ba36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c9f7edb-2175-4575-ac11-781015e25a57", "name": "network-vif-deleted", "tag": "c6b87a06-7611-406e-8113-f1a3bada6e72"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:14:49.000205 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-3974aff8-2ac0-47c1-9ac9-bd8dd45ef2ed req-cc5d3bd5-ec26-4213-9787-7a20b9a0ba36 service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:14:49.000676 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-3974aff8-2ac0-47c1-9ac9-bd8dd45ef2ed req-cc5d3bd5-ec26-4213-9787-7a20b9a0ba36 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:14:49.001126 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-3974aff8-2ac0-47c1-9ac9-bd8dd45ef2ed req-cc5d3bd5-ec26-4213-9787-7a20b9a0ba36 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:14:49.012277 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-3974aff8-2ac0-47c1-9ac9-bd8dd45ef2ed req-cc5d3bd5-ec26-4213-9787-7a20b9a0ba36 service nova] Creating event network-vif-deleted:c6b87a06-7611-406e-8113-f1a3bada6e72 for instance 9c9f7edb-2175-4575-ac11-781015e25a57 on hv-cinder-82002 Aug 11 11:14:49.017020 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-3974aff8-2ac0-47c1-9ac9-bd8dd45ef2ed req-cc5d3bd5-ec26-4213-9787-7a20b9a0ba36 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030903 Aug 11 11:14:49.017587 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 605/1192] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:14:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:14:49.022650 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-9b4c1abb-89d9-4793-bc05-804bc40f6ac5 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:14:49.023266 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-9b4c1abb-89d9-4793-bc05-804bc40f6ac5 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] [instance: 9c9f7edb-2175-4575-ac11-781015e25a57] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:14:49.029461 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9b4c1abb-89d9-4793-bc05-804bc40f6ac5 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:14:49.029939 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9b4c1abb-89d9-4793-bc05-804bc40f6ac5 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:14:49.030373 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9b4c1abb-89d9-4793-bc05-804bc40f6ac5 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:14:49.031054 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9b4c1abb-89d9-4793-bc05-804bc40f6ac5 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:14:49.031503 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9b4c1abb-89d9-4793-bc05-804bc40f6ac5 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:14:49.031967 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-9b4c1abb-89d9-4793-bc05-804bc40f6ac5 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:14:49.093996 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-9b4c1abb-89d9-4793-bc05-804bc40f6ac5 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b2f7b56f6d94908bf00b3f21954776c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea40881648b4df393fc35c07d8f68dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:14:49.101483 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-9b4c1abb-89d9-4793-bc05-804bc40f6ac5 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] 10.222.0.48 "GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57" status: 200 len: 1381 microversion: 2.1 time: 0.082860 Aug 11 11:14:49.102039 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 588/1193] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:14:49 2022] GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57 => generated 1381 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:14:49.814790 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-9eb85376-ac08-4035-8600-21a89dc27498 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "102b53b8-93f6-4117-8abe-de8abeddd9fe"}} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:14:49.817228 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-9eb85376-ac08-4035-8600-21a89dc27498 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: 1fbce1d9-88f9-46f8-96c6-04dd43180259] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:14:49.823296 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9eb85376-ac08-4035-8600-21a89dc27498 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:14:49.823802 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9eb85376-ac08-4035-8600-21a89dc27498 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:14:49.824239 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9eb85376-ac08-4035-8600-21a89dc27498 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:14:49.824921 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9eb85376-ac08-4035-8600-21a89dc27498 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:14:49.825371 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9eb85376-ac08-4035-8600-21a89dc27498 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:14:49.825794 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-9eb85376-ac08-4035-8600-21a89dc27498 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:14:50.122764 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-ded81918-07a8-443b-8eed-8de3f192bc37 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:14:50.123313 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-ded81918-07a8-443b-8eed-8de3f192bc37 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] [instance: 9c9f7edb-2175-4575-ac11-781015e25a57] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:14:50.129920 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ded81918-07a8-443b-8eed-8de3f192bc37 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:14:50.130398 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ded81918-07a8-443b-8eed-8de3f192bc37 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:14:50.130832 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ded81918-07a8-443b-8eed-8de3f192bc37 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:14:50.131511 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ded81918-07a8-443b-8eed-8de3f192bc37 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:14:50.131991 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ded81918-07a8-443b-8eed-8de3f192bc37 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:14:50.132416 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ded81918-07a8-443b-8eed-8de3f192bc37 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:14:50.163956 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ded81918-07a8-443b-8eed-8de3f192bc37 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:14:50.164428 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ded81918-07a8-443b-8eed-8de3f192bc37 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:14:50.164858 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-ded81918-07a8-443b-8eed-8de3f192bc37 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:14:50.165301 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.objects.instance [None req-ded81918-07a8-443b-8eed-8de3f192bc37 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lazy-loading 'fault' on Instance uuid 9c9f7edb-2175-4575-ac11-781015e25a57 {{(pid=121231) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 11:14:50.205167 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-ded81918-07a8-443b-8eed-8de3f192bc37 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7b2f7b56f6d94908bf00b3f21954776c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cea40881648b4df393fc35c07d8f68dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:14:50.213833 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-ded81918-07a8-443b-8eed-8de3f192bc37 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] 10.222.0.48 "GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57" status: 200 len: 1224 microversion: 2.1 time: 0.095314 Aug 11 11:14:50.214398 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 589/1194] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:14:50 2022] GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57 => generated 1224 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 11:14:50.841197 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-9eb85376-ac08-4035-8600-21a89dc27498 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "POST /compute/v2.1/servers/1fbce1d9-88f9-46f8-96c6-04dd43180259/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.030513 Aug 11 11:14:50.842097 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 606/1195] 10.222.0.48 () {60 vars in 1323 bytes} [Thu Aug 11 11:14:49 2022] POST /compute/v2.1/servers/1fbce1d9-88f9-46f8-96c6-04dd43180259/os-volume_attachments => generated 194 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:14:51.240952 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-4e1b4615-a50a-4516-8bb6-d6f8fde51709 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:14:51.241565 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-4e1b4615-a50a-4516-8bb6-d6f8fde51709 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] [instance: 9c9f7edb-2175-4575-ac11-781015e25a57] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:14:51.248594 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4e1b4615-a50a-4516-8bb6-d6f8fde51709 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:14:51.249071 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4e1b4615-a50a-4516-8bb6-d6f8fde51709 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:14:51.249505 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4e1b4615-a50a-4516-8bb6-d6f8fde51709 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:14:51.250187 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4e1b4615-a50a-4516-8bb6-d6f8fde51709 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:14:51.250636 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4e1b4615-a50a-4516-8bb6-d6f8fde51709 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:14:51.251061 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4e1b4615-a50a-4516-8bb6-d6f8fde51709 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:14:51.264379 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.wsgi [None req-4e1b4615-a50a-4516-8bb6-d6f8fde51709 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] HTTP exception thrown: Instance 9c9f7edb-2175-4575-ac11-781015e25a57 could not be found. Aug 11 11:14:51.265987 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-4e1b4615-a50a-4516-8bb6-d6f8fde51709 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Request method failure captured: Aug 11 11:14:51.265987 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: request: GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57 HTTP/1.1 Aug 11 11:14:51.265987 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Accept: application/json Aug 11 11:14:51.265987 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Accept-Encoding: identity Aug 11 11:14:51.265987 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Connection: close Aug 11 11:14:51.265987 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Content-Length: 0 Aug 11 11:14:51.265987 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Content-Type: application/json Aug 11 11:14:51.265987 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Host: 10.222.0.48 Aug 11 11:14:51.265987 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Openstack-System-Scope: None Aug 11 11:14:51.265987 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: User-Agent: python-urllib3/1.26.11 Aug 11 11:14:51.265987 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Auth-Token: gAAAAABi9ONuRPpE67vjvhCpY6Z7dvDFEofvVkRoZKNklXh45PFHs4BWzHZa_7nbRrBtSxvntj5_d0NHsL3v4xDBmCtCT0vuwrtkMGVAsa6rNzXQsJGFyvI0UTz0wPJ9piNa8chqHvw1MBpNOQNr0DxYSAGH7kKGnIZ_Usom3St-nfpwTVEPMp4 Aug 11 11:14:51.265987 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Domain-Id: None Aug 11 11:14:51.265987 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Domain-Name: None Aug 11 11:14:51.265987 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Identity-Status: Confirmed Aug 11 11:14:51.265987 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Is-Admin-Project: True Aug 11 11:14:51.265987 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Domain-Id: default Aug 11 11:14:51.265987 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Domain-Name: Default Aug 11 11:14:51.265987 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Id: cea40881648b4df393fc35c07d8f68dd Aug 11 11:14:51.265987 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Name: tempest-TestShelveInstance-1192296872 Aug 11 11:14:51.265987 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Role: reader,member Aug 11 11:14:51.265987 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Roles: reader,member Aug 11 11:14:51.267737 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/cea40881648b4df393fc35c07d8f68dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/cea40881648b4df393fc35c07d8f68dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/cea40881648b4df393fc35c07d8f68dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_cea40881648b4df393fc35c07d8f68dd", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] Aug 11 11:14:51.267737 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant: tempest-TestShelveInstance-1192296872 Aug 11 11:14:51.267737 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant-Id: cea40881648b4df393fc35c07d8f68dd Aug 11 11:14:51.267737 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant-Name: tempest-TestShelveInstance-1192296872 Aug 11 11:14:51.267737 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User: tempest-TestShelveInstance-1192296872-project Aug 11 11:14:51.267737 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Domain-Id: default Aug 11 11:14:51.267737 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Domain-Name: Default Aug 11 11:14:51.267737 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Id: 7b2f7b56f6d94908bf00b3f21954776c Aug 11 11:14:51.267737 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Name: tempest-TestShelveInstance-1192296872-project Aug 11 11:14:51.267737 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: method: > Aug 11 11:14:51.267737 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: exception: Instance 9c9f7edb-2175-4575-ac11-781015e25a57 could not be found. Aug 11 11:14:51.267737 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: action_args: {'id': '9c9f7edb-2175-4575-ac11-781015e25a57'} Aug 11 11:14:51.268624 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 11:14:51.268624 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:14:51.268624 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 11:14:51.268624 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 11:14:51.268624 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 11:14:51.268624 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 11:14:51.268624 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 11:14:51.268624 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 11:14:51.268624 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 11:14:51.268624 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 11:14:51.268624 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c9f7edb-2175-4575-ac11-781015e25a57 could not be found. Aug 11 11:14:51.268624 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:14:51.268624 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:14:51.268624 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:14:51.268624 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:14:51.268624 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:14:51.268624 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:14:51.268624 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 11:14:51.268624 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 11:14:51.268624 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 11:14:51.270004 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 11:14:51.270004 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 11:14:51.270004 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 11:14:51.270004 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 11:14:51.270004 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 11:14:51.270004 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 11:14:51.270004 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 11:14:51.270004 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c9f7edb-2175-4575-ac11-781015e25a57 could not be found. Aug 11 11:14:51.270004 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:14:51.270004 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:14:51.270004 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:14:51.270004 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:14:51.270004 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:14:51.270004 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:14:51.270004 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 11:14:51.270004 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 11:14:51.270004 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c9f7edb-2175-4575-ac11-781015e25a57 could not be found. Aug 11 11:14:51.270004 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:14:51.271487 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-4e1b4615-a50a-4516-8bb6-d6f8fde51709 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Returning 404 to user: Instance 9c9f7edb-2175-4575-ac11-781015e25a57 could not be found. {{(pid=121231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 11:14:51.271487 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-4e1b4615-a50a-4516-8bb6-d6f8fde51709 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] 10.222.0.48 "GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57" status: 404 len: 111 microversion: 2.1 time: 0.030318 Aug 11 11:14:51.271487 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 590/1196] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:14:51 2022] GET /compute/v2.1/servers/9c9f7edb-2175-4575-ac11-781015e25a57 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 11:14:51.479880 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-8cccaf9b-92bf-44fa-b6f7-fd66cdfeed27 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] Calling method '.version_select at 0x7faab0c491f0>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:14:51.598941 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-8cccaf9b-92bf-44fa-b6f7-fd66cdfeed27 tempest-TestShelveInstance-1192296872 tempest-TestShelveInstance-1192296872-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-515909715" status: 202 len: 0 microversion: 2.1 time: 0.124413 Aug 11 11:14:51.599540 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 607/1197] 10.222.0.48 () {58 vars in 1251 bytes} [Thu Aug 11 11:14:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-515909715 => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 11:14:59.579351 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-7c724eb3-0465-4f30-9b3a-a3c37fd57db6 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:14:59.579862 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-7c724eb3-0465-4f30-9b3a-a3c37fd57db6 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: 1fbce1d9-88f9-46f8-96c6-04dd43180259] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:14:59.582400 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:14:59.587506 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7c724eb3-0465-4f30-9b3a-a3c37fd57db6 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:14:59.595039 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7c724eb3-0465-4f30-9b3a-a3c37fd57db6 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:14:59.595039 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7c724eb3-0465-4f30-9b3a-a3c37fd57db6 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:14:59.595039 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7c724eb3-0465-4f30-9b3a-a3c37fd57db6 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:14:59.595039 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7c724eb3-0465-4f30-9b3a-a3c37fd57db6 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:14:59.595452 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-7c724eb3-0465-4f30-9b3a-a3c37fd57db6 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:14:59.595452 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:14:59.673511 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.objects.instance [None req-7c724eb3-0465-4f30-9b3a-a3c37fd57db6 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lazy-loading 'services' on Instance uuid 1fbce1d9-88f9-46f8-96c6-04dd43180259 {{(pid=121231) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 11:14:59.958173 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-7c724eb3-0465-4f30-9b3a-a3c37fd57db6 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "DELETE /compute/v2.1/servers/1fbce1d9-88f9-46f8-96c6-04dd43180259/os-volume_attachments/102b53b8-93f6-4117-8abe-de8abeddd9fe" status: 202 len: 0 microversion: 2.1 time: 0.382483 Aug 11 11:14:59.958726 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 591/1198] 10.222.0.48 () {58 vars in 1416 bytes} [Thu Aug 11 11:14:59 2022] DELETE /compute/v2.1/servers/1fbce1d9-88f9-46f8-96c6-04dd43180259/os-volume_attachments/102b53b8-93f6-4117-8abe-de8abeddd9fe => generated 0 bytes in 384 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 11:14:59.969859 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-53d8d14a-e7ef-4305-9171-6b45cc55ccf9 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:14:59.972432 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-53d8d14a-e7ef-4305-9171-6b45cc55ccf9 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: 1fbce1d9-88f9-46f8-96c6-04dd43180259] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:14:59.975748 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_api:SELECT=38,nova_api:DELETE=1 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:14:59.980848 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-53d8d14a-e7ef-4305-9171-6b45cc55ccf9 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:14:59.981982 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-53d8d14a-e7ef-4305-9171-6b45cc55ccf9 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:14:59.982494 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-53d8d14a-e7ef-4305-9171-6b45cc55ccf9 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:14:59.983305 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-53d8d14a-e7ef-4305-9171-6b45cc55ccf9 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:14:59.983840 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-53d8d14a-e7ef-4305-9171-6b45cc55ccf9 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:14:59.984270 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-53d8d14a-e7ef-4305-9171-6b45cc55ccf9 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:14:59.986915 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:15:00.015995 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-53d8d14a-e7ef-4305-9171-6b45cc55ccf9 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/1fbce1d9-88f9-46f8-96c6-04dd43180259/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052528 Aug 11 11:15:00.016535 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 608/1199] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Aug 11 11:14:59 2022] GET /compute/v2.1/servers/1fbce1d9-88f9-46f8-96c6-04dd43180259/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:15:01.030858 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-28e4721c-f310-4a4b-b247-620df762773b tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:15:01.033275 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-28e4721c-f310-4a4b-b247-620df762773b tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: 1fbce1d9-88f9-46f8-96c6-04dd43180259] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:15:01.040319 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-28e4721c-f310-4a4b-b247-620df762773b tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:15:01.040806 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-28e4721c-f310-4a4b-b247-620df762773b tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:15:01.041258 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-28e4721c-f310-4a4b-b247-620df762773b tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:15:01.042087 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-28e4721c-f310-4a4b-b247-620df762773b tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:15:01.053178 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-28e4721c-f310-4a4b-b247-620df762773b tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:15:01.053178 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-28e4721c-f310-4a4b-b247-620df762773b tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:15:01.073695 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-28e4721c-f310-4a4b-b247-620df762773b tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/1fbce1d9-88f9-46f8-96c6-04dd43180259/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048806 Aug 11 11:15:01.074289 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 592/1200] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Aug 11 11:15:01 2022] GET /compute/v2.1/servers/1fbce1d9-88f9-46f8-96c6-04dd43180259/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:15:02.086627 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-e228d182-5bd2-42b7-8a28-5adabdf49ac2 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:15:02.088783 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-e228d182-5bd2-42b7-8a28-5adabdf49ac2 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: 1fbce1d9-88f9-46f8-96c6-04dd43180259] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:15:02.097670 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e228d182-5bd2-42b7-8a28-5adabdf49ac2 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:15:02.113950 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e228d182-5bd2-42b7-8a28-5adabdf49ac2 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:15:02.113950 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e228d182-5bd2-42b7-8a28-5adabdf49ac2 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:15:02.113950 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e228d182-5bd2-42b7-8a28-5adabdf49ac2 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:15:02.113950 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e228d182-5bd2-42b7-8a28-5adabdf49ac2 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:15:02.114307 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e228d182-5bd2-42b7-8a28-5adabdf49ac2 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:15:02.128920 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-e228d182-5bd2-42b7-8a28-5adabdf49ac2 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/1fbce1d9-88f9-46f8-96c6-04dd43180259/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046741 Aug 11 11:15:02.129479 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 609/1201] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Aug 11 11:15:02 2022] GET /compute/v2.1/servers/1fbce1d9-88f9-46f8-96c6-04dd43180259/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 11 11:15:02.194248 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-e8a5d2ce-3b6e-4a06-9920-a2d83bd002da tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:15:02.194748 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-e8a5d2ce-3b6e-4a06-9920-a2d83bd002da tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: 1fbce1d9-88f9-46f8-96c6-04dd43180259] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:15:02.201100 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e8a5d2ce-3b6e-4a06-9920-a2d83bd002da tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:15:02.201583 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e8a5d2ce-3b6e-4a06-9920-a2d83bd002da tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:15:02.202020 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e8a5d2ce-3b6e-4a06-9920-a2d83bd002da tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:15:02.202702 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e8a5d2ce-3b6e-4a06-9920-a2d83bd002da tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:15:02.203153 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e8a5d2ce-3b6e-4a06-9920-a2d83bd002da tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:15:02.203576 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e8a5d2ce-3b6e-4a06-9920-a2d83bd002da tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:15:02.228479 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-e8a5d2ce-3b6e-4a06-9920-a2d83bd002da tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: 1fbce1d9-88f9-46f8-96c6-04dd43180259] Going to try to terminate instance {{(pid=121231) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 11 11:15:02.590348 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-e8a5d2ce-3b6e-4a06-9920-a2d83bd002da tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "DELETE /compute/v2.1/servers/1fbce1d9-88f9-46f8-96c6-04dd43180259" status: 204 len: 0 microversion: 2.1 time: 0.399616 Aug 11 11:15:02.590940 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 593/1202] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Aug 11 11:15:02 2022] DELETE /compute/v2.1/servers/1fbce1d9-88f9-46f8-96c6-04dd43180259 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 11 11:15:02.600808 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-369f67b6-29b5-4c3c-ae5f-fa2a303967a1 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:15:02.601433 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-369f67b6-29b5-4c3c-ae5f-fa2a303967a1 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: 1fbce1d9-88f9-46f8-96c6-04dd43180259] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:15:02.609528 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-369f67b6-29b5-4c3c-ae5f-fa2a303967a1 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:15:02.610011 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-369f67b6-29b5-4c3c-ae5f-fa2a303967a1 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:15:02.610443 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-369f67b6-29b5-4c3c-ae5f-fa2a303967a1 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:15:02.611127 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-369f67b6-29b5-4c3c-ae5f-fa2a303967a1 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:15:02.611574 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-369f67b6-29b5-4c3c-ae5f-fa2a303967a1 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:15:02.612024 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-369f67b6-29b5-4c3c-ae5f-fa2a303967a1 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:15:02.739899 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-369f67b6-29b5-4c3c-ae5f-fa2a303967a1 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08d81bcd5a4f43ce8b4839ee15cb163b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56bd2a662e34a6395117027b5c28c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:15:02.747298 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-369f67b6-29b5-4c3c-ae5f-fa2a303967a1 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/1fbce1d9-88f9-46f8-96c6-04dd43180259" status: 200 len: 1683 microversion: 2.1 time: 0.151569 Aug 11 11:15:02.747878 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 610/1203] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:15:02 2022] GET /compute/v2.1/servers/1fbce1d9-88f9-46f8-96c6-04dd43180259 => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:15:03.768958 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-dbd58ae3-dc26-4b76-bf1a-c3c0ad9c37a9 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:15:03.769660 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-dbd58ae3-dc26-4b76-bf1a-c3c0ad9c37a9 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: 1fbce1d9-88f9-46f8-96c6-04dd43180259] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:15:03.776146 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-dbd58ae3-dc26-4b76-bf1a-c3c0ad9c37a9 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:15:03.776629 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-dbd58ae3-dc26-4b76-bf1a-c3c0ad9c37a9 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:15:03.777067 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-dbd58ae3-dc26-4b76-bf1a-c3c0ad9c37a9 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:15:03.777751 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-dbd58ae3-dc26-4b76-bf1a-c3c0ad9c37a9 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:15:03.778203 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-dbd58ae3-dc26-4b76-bf1a-c3c0ad9c37a9 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:15:03.778628 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-dbd58ae3-dc26-4b76-bf1a-c3c0ad9c37a9 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:15:03.911480 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-dbd58ae3-dc26-4b76-bf1a-c3c0ad9c37a9 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08d81bcd5a4f43ce8b4839ee15cb163b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56bd2a662e34a6395117027b5c28c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:15:03.919066 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-dbd58ae3-dc26-4b76-bf1a-c3c0ad9c37a9 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/1fbce1d9-88f9-46f8-96c6-04dd43180259" status: 200 len: 1683 microversion: 2.1 time: 0.154348 Aug 11 11:15:03.919631 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 594/1204] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:15:03 2022] GET /compute/v2.1/servers/1fbce1d9-88f9-46f8-96c6-04dd43180259 => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:15:04.941357 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-b3d3de50-128a-406a-812d-4aa779b1ed53 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:15:04.942037 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-b3d3de50-128a-406a-812d-4aa779b1ed53 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: 1fbce1d9-88f9-46f8-96c6-04dd43180259] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:15:04.948416 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b3d3de50-128a-406a-812d-4aa779b1ed53 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:15:04.948893 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b3d3de50-128a-406a-812d-4aa779b1ed53 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:15:04.949320 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b3d3de50-128a-406a-812d-4aa779b1ed53 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:15:04.949998 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b3d3de50-128a-406a-812d-4aa779b1ed53 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:15:04.950441 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b3d3de50-128a-406a-812d-4aa779b1ed53 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:15:04.950858 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b3d3de50-128a-406a-812d-4aa779b1ed53 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:15:05.089365 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-b3d3de50-128a-406a-812d-4aa779b1ed53 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08d81bcd5a4f43ce8b4839ee15cb163b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56bd2a662e34a6395117027b5c28c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:15:05.097082 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-b3d3de50-128a-406a-812d-4aa779b1ed53 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/1fbce1d9-88f9-46f8-96c6-04dd43180259" status: 200 len: 1683 microversion: 2.1 time: 0.160568 Aug 11 11:15:05.097651 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 611/1205] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:15:04 2022] GET /compute/v2.1/servers/1fbce1d9-88f9-46f8-96c6-04dd43180259 => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:15:05.631054 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-0c9aeaa2-7d58-4d08-8530-0d8422157041 req-d343d628-5919-47c4-b762-92db8e3f8186 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fbce1d9-88f9-46f8-96c6-04dd43180259", "name": "network-vif-deleted", "tag": "d14b79b9-819d-4c3b-b0a3-d9a3809d0ae8"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:15:05.641501 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-0c9aeaa2-7d58-4d08-8530-0d8422157041 req-d343d628-5919-47c4-b762-92db8e3f8186 service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:15:05.644927 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-0c9aeaa2-7d58-4d08-8530-0d8422157041 req-d343d628-5919-47c4-b762-92db8e3f8186 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:15:05.644927 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-0c9aeaa2-7d58-4d08-8530-0d8422157041 req-d343d628-5919-47c4-b762-92db8e3f8186 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:15:05.653879 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-0c9aeaa2-7d58-4d08-8530-0d8422157041 req-d343d628-5919-47c4-b762-92db8e3f8186 service nova] Creating event network-vif-deleted:d14b79b9-819d-4c3b-b0a3-d9a3809d0ae8 for instance 1fbce1d9-88f9-46f8-96c6-04dd43180259 on hv-cinder-82002 Aug 11 11:15:05.659662 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-0c9aeaa2-7d58-4d08-8530-0d8422157041 req-d343d628-5919-47c4-b762-92db8e3f8186 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032625 Aug 11 11:15:05.661032 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 595/1206] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:15:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:15:06.119215 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-cb44b91e-a349-4128-941e-328684f2356d tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:15:06.120088 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-cb44b91e-a349-4128-941e-328684f2356d tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: 1fbce1d9-88f9-46f8-96c6-04dd43180259] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:15:06.127599 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cb44b91e-a349-4128-941e-328684f2356d tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:15:06.128122 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cb44b91e-a349-4128-941e-328684f2356d tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:15:06.128565 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cb44b91e-a349-4128-941e-328684f2356d tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:15:06.129278 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cb44b91e-a349-4128-941e-328684f2356d tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:15:06.129731 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cb44b91e-a349-4128-941e-328684f2356d tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:15:06.130188 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cb44b91e-a349-4128-941e-328684f2356d tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:15:06.165188 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cb44b91e-a349-4128-941e-328684f2356d tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:15:06.165676 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cb44b91e-a349-4128-941e-328684f2356d tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:15:06.166113 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-cb44b91e-a349-4128-941e-328684f2356d tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:15:06.166565 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.objects.instance [None req-cb44b91e-a349-4128-941e-328684f2356d tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lazy-loading 'fault' on Instance uuid 1fbce1d9-88f9-46f8-96c6-04dd43180259 {{(pid=121232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 11:15:06.209497 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-cb44b91e-a349-4128-941e-328684f2356d tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08d81bcd5a4f43ce8b4839ee15cb163b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c56bd2a662e34a6395117027b5c28c5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:15:06.217406 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-cb44b91e-a349-4128-941e-328684f2356d tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/1fbce1d9-88f9-46f8-96c6-04dd43180259" status: 200 len: 1332 microversion: 2.1 time: 0.102182 Aug 11 11:15:06.217973 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 612/1207] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:15:06 2022] GET /compute/v2.1/servers/1fbce1d9-88f9-46f8-96c6-04dd43180259 => generated 1332 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:15:07.239019 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-cda07261-a066-4e12-b7dc-67bf62a68818 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:15:07.239721 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-cda07261-a066-4e12-b7dc-67bf62a68818 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: 1fbce1d9-88f9-46f8-96c6-04dd43180259] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:15:07.246483 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-cda07261-a066-4e12-b7dc-67bf62a68818 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:15:07.246963 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-cda07261-a066-4e12-b7dc-67bf62a68818 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:15:07.247396 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-cda07261-a066-4e12-b7dc-67bf62a68818 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:15:07.248111 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-cda07261-a066-4e12-b7dc-67bf62a68818 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:15:07.248560 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-cda07261-a066-4e12-b7dc-67bf62a68818 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:15:07.248980 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-cda07261-a066-4e12-b7dc-67bf62a68818 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:15:07.262428 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.wsgi [None req-cda07261-a066-4e12-b7dc-67bf62a68818 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] HTTP exception thrown: Instance 1fbce1d9-88f9-46f8-96c6-04dd43180259 could not be found. Aug 11 11:15:07.264082 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-cda07261-a066-4e12-b7dc-67bf62a68818 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Request method failure captured: Aug 11 11:15:07.264082 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: request: GET /compute/v2.1/servers/1fbce1d9-88f9-46f8-96c6-04dd43180259 HTTP/1.1 Aug 11 11:15:07.264082 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Accept: application/json Aug 11 11:15:07.264082 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Accept-Encoding: identity Aug 11 11:15:07.264082 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Connection: close Aug 11 11:15:07.264082 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Content-Length: 0 Aug 11 11:15:07.264082 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Content-Type: application/json Aug 11 11:15:07.264082 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Host: 10.222.0.48 Aug 11 11:15:07.264082 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Openstack-System-Scope: None Aug 11 11:15:07.264082 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: User-Agent: python-urllib3/1.26.11 Aug 11 11:15:07.264082 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Auth-Token: gAAAAABi9ONxPYWpRmadpANSM5f1tl1wVESW1SFE62fiY511YI9uU6D_79r-yuQvgjKjvFqPWeHAiFZFw3kYac2M1zqDX4QPozx6rX_pgfB-Fgz47x90y_mKI7zGyyPs8EkLoYDiomkPvd5a4fE5iPsTlEJ3RRgCL7XDnuCGisjN8PsW1aCU_y4 Aug 11 11:15:07.264082 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Domain-Id: None Aug 11 11:15:07.264082 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Domain-Name: None Aug 11 11:15:07.264082 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Identity-Status: Confirmed Aug 11 11:15:07.264082 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Is-Admin-Project: True Aug 11 11:15:07.264082 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Domain-Id: default Aug 11 11:15:07.264082 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Domain-Name: Default Aug 11 11:15:07.264082 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Id: c56bd2a662e34a6395117027b5c28c5b Aug 11 11:15:07.264082 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Name: tempest-AttachVolumeNegativeTest-848160622 Aug 11 11:15:07.264082 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Role: reader,member Aug 11 11:15:07.264082 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Roles: reader,member Aug 11 11:15:07.265573 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c56bd2a662e34a6395117027b5c28c5b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c56bd2a662e34a6395117027b5c28c5b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c56bd2a662e34a6395117027b5c28c5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c56bd2a662e34a6395117027b5c28c5b", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] Aug 11 11:15:07.265573 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant: tempest-AttachVolumeNegativeTest-848160622 Aug 11 11:15:07.265573 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant-Id: c56bd2a662e34a6395117027b5c28c5b Aug 11 11:15:07.265573 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-848160622 Aug 11 11:15:07.265573 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User: tempest-AttachVolumeNegativeTest-848160622-project Aug 11 11:15:07.265573 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Domain-Id: default Aug 11 11:15:07.265573 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Domain-Name: Default Aug 11 11:15:07.265573 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Id: 08d81bcd5a4f43ce8b4839ee15cb163b Aug 11 11:15:07.265573 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Name: tempest-AttachVolumeNegativeTest-848160622-project Aug 11 11:15:07.265573 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: method: > Aug 11 11:15:07.265573 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: exception: Instance 1fbce1d9-88f9-46f8-96c6-04dd43180259 could not be found. Aug 11 11:15:07.265573 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: action_args: {'id': '1fbce1d9-88f9-46f8-96c6-04dd43180259'} Aug 11 11:15:07.266971 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 11:15:07.266971 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:15:07.266971 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 11:15:07.266971 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 11:15:07.266971 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 11:15:07.266971 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 11:15:07.266971 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 11:15:07.266971 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 11:15:07.266971 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 11:15:07.266971 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 11:15:07.266971 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fbce1d9-88f9-46f8-96c6-04dd43180259 could not be found. Aug 11 11:15:07.266971 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:15:07.266971 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:15:07.266971 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:15:07.266971 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:15:07.266971 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:15:07.266971 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:15:07.266971 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 11:15:07.266971 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 11:15:07.266971 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 11:15:07.268555 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 11:15:07.268555 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 11:15:07.268555 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 11:15:07.268555 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 11:15:07.268555 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 11:15:07.268555 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 11:15:07.268555 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 11:15:07.268555 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fbce1d9-88f9-46f8-96c6-04dd43180259 could not be found. Aug 11 11:15:07.268555 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:15:07.268555 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:15:07.268555 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:15:07.268555 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:15:07.268555 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:15:07.268555 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:15:07.268555 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 11:15:07.268555 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 11:15:07.268555 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fbce1d9-88f9-46f8-96c6-04dd43180259 could not be found. Aug 11 11:15:07.268555 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:15:07.270026 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-cda07261-a066-4e12-b7dc-67bf62a68818 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Returning 404 to user: Instance 1fbce1d9-88f9-46f8-96c6-04dd43180259 could not be found. {{(pid=121231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 11:15:07.270026 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-cda07261-a066-4e12-b7dc-67bf62a68818 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/1fbce1d9-88f9-46f8-96c6-04dd43180259" status: 404 len: 111 microversion: 2.1 time: 0.030684 Aug 11 11:15:07.270026 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 596/1208] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:15:07 2022] GET /compute/v2.1/servers/1fbce1d9-88f9-46f8-96c6-04dd43180259 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 11:15:07.275101 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-79798e36-3228-4a2e-bbbd-2e90acb9f07c tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '.version_select at 0x7faab0c479d0>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:15:07.356976 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-79798e36-3228-4a2e-bbbd-2e90acb9f07c tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1733680468" status: 202 len: 0 microversion: 2.1 time: 0.085702 Aug 11 11:15:07.357544 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 613/1209] 10.222.0.48 () {58 vars in 1221 bytes} [Thu Aug 11 11:15:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1733680468 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 11:15:09.425470 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-57ac81d4-68d2-4398-938b-25fec553e154 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:15:09.425963 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-57ac81d4-68d2-4398-938b-25fec553e154 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: 1fbce1d9-88f9-46f8-96c6-04dd43180259] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:15:09.432315 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-57ac81d4-68d2-4398-938b-25fec553e154 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:15:09.432794 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-57ac81d4-68d2-4398-938b-25fec553e154 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:15:09.433232 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-57ac81d4-68d2-4398-938b-25fec553e154 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:15:09.433913 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-57ac81d4-68d2-4398-938b-25fec553e154 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:15:09.434363 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-57ac81d4-68d2-4398-938b-25fec553e154 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:15:09.434784 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-57ac81d4-68d2-4398-938b-25fec553e154 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:15:09.448030 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.wsgi [None req-57ac81d4-68d2-4398-938b-25fec553e154 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] HTTP exception thrown: Instance 1fbce1d9-88f9-46f8-96c6-04dd43180259 could not be found. Aug 11 11:15:09.449543 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-57ac81d4-68d2-4398-938b-25fec553e154 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Request method failure captured: Aug 11 11:15:09.449543 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: request: DELETE /compute/v2.1/servers/1fbce1d9-88f9-46f8-96c6-04dd43180259 HTTP/1.1 Aug 11 11:15:09.449543 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Accept: application/json Aug 11 11:15:09.449543 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Accept-Encoding: identity Aug 11 11:15:09.449543 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Connection: close Aug 11 11:15:09.449543 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Content-Length: 0 Aug 11 11:15:09.449543 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Content-Type: application/json Aug 11 11:15:09.449543 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Host: 10.222.0.48 Aug 11 11:15:09.449543 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Openstack-System-Scope: None Aug 11 11:15:09.449543 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: User-Agent: python-urllib3/1.26.11 Aug 11 11:15:09.449543 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Auth-Token: gAAAAABi9ONxPYWpRmadpANSM5f1tl1wVESW1SFE62fiY511YI9uU6D_79r-yuQvgjKjvFqPWeHAiFZFw3kYac2M1zqDX4QPozx6rX_pgfB-Fgz47x90y_mKI7zGyyPs8EkLoYDiomkPvd5a4fE5iPsTlEJ3RRgCL7XDnuCGisjN8PsW1aCU_y4 Aug 11 11:15:09.449543 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Domain-Id: None Aug 11 11:15:09.449543 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Domain-Name: None Aug 11 11:15:09.449543 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Identity-Status: Confirmed Aug 11 11:15:09.449543 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Is-Admin-Project: True Aug 11 11:15:09.449543 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Domain-Id: default Aug 11 11:15:09.449543 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Domain-Name: Default Aug 11 11:15:09.449543 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Id: c56bd2a662e34a6395117027b5c28c5b Aug 11 11:15:09.449543 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Name: tempest-AttachVolumeNegativeTest-848160622 Aug 11 11:15:09.449543 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Role: reader,member Aug 11 11:15:09.449543 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Roles: reader,member Aug 11 11:15:09.454172 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c56bd2a662e34a6395117027b5c28c5b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c56bd2a662e34a6395117027b5c28c5b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c56bd2a662e34a6395117027b5c28c5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c56bd2a662e34a6395117027b5c28c5b", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] Aug 11 11:15:09.454172 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant: tempest-AttachVolumeNegativeTest-848160622 Aug 11 11:15:09.454172 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant-Id: c56bd2a662e34a6395117027b5c28c5b Aug 11 11:15:09.454172 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-848160622 Aug 11 11:15:09.454172 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User: tempest-AttachVolumeNegativeTest-848160622-project Aug 11 11:15:09.454172 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Domain-Id: default Aug 11 11:15:09.454172 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Domain-Name: Default Aug 11 11:15:09.454172 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Id: 08d81bcd5a4f43ce8b4839ee15cb163b Aug 11 11:15:09.454172 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Name: tempest-AttachVolumeNegativeTest-848160622-project Aug 11 11:15:09.454172 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: method: > Aug 11 11:15:09.454172 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: exception: Instance 1fbce1d9-88f9-46f8-96c6-04dd43180259 could not be found. Aug 11 11:15:09.454172 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: action_args: {'id': '1fbce1d9-88f9-46f8-96c6-04dd43180259'} Aug 11 11:15:09.455102 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 11:15:09.455102 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:15:09.455102 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 11:15:09.455102 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 11:15:09.455102 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 11:15:09.455102 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 11:15:09.455102 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 11:15:09.455102 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 11:15:09.455102 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 11:15:09.455102 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 11:15:09.455102 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fbce1d9-88f9-46f8-96c6-04dd43180259 could not be found. Aug 11 11:15:09.455102 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:15:09.455102 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:15:09.455102 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:15:09.455102 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:15:09.455102 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:15:09.455102 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:15:09.455102 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 11:15:09.455102 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 11:15:09.455102 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 11:15:09.456695 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 11:15:09.456695 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 11 11:15:09.456695 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 11 11:15:09.456695 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 11 11:15:09.456695 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 11 11:15:09.456695 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 11:15:09.456695 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 11:15:09.456695 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 11:15:09.456695 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 11:15:09.456695 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fbce1d9-88f9-46f8-96c6-04dd43180259 could not be found. Aug 11 11:15:09.456695 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:15:09.456695 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:15:09.456695 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:15:09.456695 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:15:09.456695 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:15:09.456695 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:15:09.456695 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 11:15:09.456695 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 11:15:09.456695 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fbce1d9-88f9-46f8-96c6-04dd43180259 could not be found. Aug 11 11:15:09.456695 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:15:09.458239 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-57ac81d4-68d2-4398-938b-25fec553e154 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Returning 404 to user: Instance 1fbce1d9-88f9-46f8-96c6-04dd43180259 could not be found. {{(pid=121231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 11:15:09.458239 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-57ac81d4-68d2-4398-938b-25fec553e154 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "DELETE /compute/v2.1/servers/1fbce1d9-88f9-46f8-96c6-04dd43180259" status: 404 len: 111 microversion: 2.1 time: 0.029958 Aug 11 11:15:09.458239 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 597/1210] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Aug 11 11:15:09 2022] DELETE /compute/v2.1/servers/1fbce1d9-88f9-46f8-96c6-04dd43180259 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 11:15:09.459689 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-3c8a45a7-a0dc-4020-80f5-dfdac517ad1e tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:15:09.460341 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-3c8a45a7-a0dc-4020-80f5-dfdac517ad1e tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: 1fbce1d9-88f9-46f8-96c6-04dd43180259] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:15:09.466939 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3c8a45a7-a0dc-4020-80f5-dfdac517ad1e tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:15:09.467417 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3c8a45a7-a0dc-4020-80f5-dfdac517ad1e tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:15:09.467879 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3c8a45a7-a0dc-4020-80f5-dfdac517ad1e tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:15:09.468563 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3c8a45a7-a0dc-4020-80f5-dfdac517ad1e tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:15:09.469012 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3c8a45a7-a0dc-4020-80f5-dfdac517ad1e tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:15:09.469434 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-3c8a45a7-a0dc-4020-80f5-dfdac517ad1e tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:15:09.483315 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.wsgi [None req-3c8a45a7-a0dc-4020-80f5-dfdac517ad1e tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] HTTP exception thrown: Instance 1fbce1d9-88f9-46f8-96c6-04dd43180259 could not be found. Aug 11 11:15:09.485129 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-3c8a45a7-a0dc-4020-80f5-dfdac517ad1e tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Request method failure captured: Aug 11 11:15:09.485129 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: request: GET /compute/v2.1/servers/1fbce1d9-88f9-46f8-96c6-04dd43180259 HTTP/1.1 Aug 11 11:15:09.485129 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Accept: application/json Aug 11 11:15:09.485129 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Accept-Encoding: identity Aug 11 11:15:09.485129 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Connection: close Aug 11 11:15:09.485129 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Content-Length: 0 Aug 11 11:15:09.485129 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Content-Type: application/json Aug 11 11:15:09.485129 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Host: 10.222.0.48 Aug 11 11:15:09.485129 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Openstack-System-Scope: None Aug 11 11:15:09.485129 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: User-Agent: python-urllib3/1.26.11 Aug 11 11:15:09.485129 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Auth-Token: gAAAAABi9ONxPYWpRmadpANSM5f1tl1wVESW1SFE62fiY511YI9uU6D_79r-yuQvgjKjvFqPWeHAiFZFw3kYac2M1zqDX4QPozx6rX_pgfB-Fgz47x90y_mKI7zGyyPs8EkLoYDiomkPvd5a4fE5iPsTlEJ3RRgCL7XDnuCGisjN8PsW1aCU_y4 Aug 11 11:15:09.485129 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Domain-Id: None Aug 11 11:15:09.485129 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Domain-Name: None Aug 11 11:15:09.485129 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Identity-Status: Confirmed Aug 11 11:15:09.485129 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Is-Admin-Project: True Aug 11 11:15:09.485129 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Domain-Id: default Aug 11 11:15:09.485129 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Domain-Name: Default Aug 11 11:15:09.485129 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Id: c56bd2a662e34a6395117027b5c28c5b Aug 11 11:15:09.485129 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Name: tempest-AttachVolumeNegativeTest-848160622 Aug 11 11:15:09.485129 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Role: reader,member Aug 11 11:15:09.485129 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Roles: reader,member Aug 11 11:15:09.487358 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c56bd2a662e34a6395117027b5c28c5b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c56bd2a662e34a6395117027b5c28c5b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c56bd2a662e34a6395117027b5c28c5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c56bd2a662e34a6395117027b5c28c5b", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] Aug 11 11:15:09.487358 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Tenant: tempest-AttachVolumeNegativeTest-848160622 Aug 11 11:15:09.487358 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Tenant-Id: c56bd2a662e34a6395117027b5c28c5b Aug 11 11:15:09.487358 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-848160622 Aug 11 11:15:09.487358 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User: tempest-AttachVolumeNegativeTest-848160622-project Aug 11 11:15:09.487358 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Domain-Id: default Aug 11 11:15:09.487358 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Domain-Name: Default Aug 11 11:15:09.487358 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Id: 08d81bcd5a4f43ce8b4839ee15cb163b Aug 11 11:15:09.487358 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Name: tempest-AttachVolumeNegativeTest-848160622-project Aug 11 11:15:09.487358 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: method: > Aug 11 11:15:09.487358 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: exception: Instance 1fbce1d9-88f9-46f8-96c6-04dd43180259 could not be found. Aug 11 11:15:09.487358 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: action_args: {'id': '1fbce1d9-88f9-46f8-96c6-04dd43180259'} Aug 11 11:15:09.488475 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 11:15:09.488475 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:15:09.488475 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 11:15:09.488475 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 11:15:09.488475 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 11:15:09.488475 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 11:15:09.488475 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 11:15:09.488475 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 11:15:09.488475 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 11:15:09.488475 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 11:15:09.488475 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fbce1d9-88f9-46f8-96c6-04dd43180259 could not be found. Aug 11 11:15:09.488475 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:15:09.488475 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:15:09.488475 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:15:09.488475 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:15:09.488475 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:15:09.488475 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:15:09.488475 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 11:15:09.488475 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 11:15:09.488475 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 11:15:09.490006 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 11:15:09.490006 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 11:15:09.490006 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 11:15:09.490006 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 11:15:09.490006 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 11:15:09.490006 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 11:15:09.490006 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 11:15:09.490006 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fbce1d9-88f9-46f8-96c6-04dd43180259 could not be found. Aug 11 11:15:09.490006 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:15:09.490006 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:15:09.490006 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:15:09.490006 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:15:09.490006 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:15:09.490006 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:15:09.490006 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 11:15:09.490006 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 11:15:09.490006 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fbce1d9-88f9-46f8-96c6-04dd43180259 could not be found. Aug 11 11:15:09.490006 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:15:09.491532 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-3c8a45a7-a0dc-4020-80f5-dfdac517ad1e tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Returning 404 to user: Instance 1fbce1d9-88f9-46f8-96c6-04dd43180259 could not be found. {{(pid=121232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 11:15:09.491532 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-3c8a45a7-a0dc-4020-80f5-dfdac517ad1e tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/1fbce1d9-88f9-46f8-96c6-04dd43180259" status: 404 len: 111 microversion: 2.1 time: 0.031819 Aug 11 11:15:09.491532 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 614/1211] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:15:09 2022] GET /compute/v2.1/servers/1fbce1d9-88f9-46f8-96c6-04dd43180259 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 11 11:15:10.787963 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-2eb7f8a0-559f-499f-835f-0e84a5b7ea59 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:15:10.788478 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-2eb7f8a0-559f-499f-835f-0e84a5b7ea59 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: 5a7a6694-e9a6-4914-a702-51fcc95a5233] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:15:10.794908 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2eb7f8a0-559f-499f-835f-0e84a5b7ea59 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:15:10.795385 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2eb7f8a0-559f-499f-835f-0e84a5b7ea59 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:15:10.795850 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2eb7f8a0-559f-499f-835f-0e84a5b7ea59 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:15:10.796539 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2eb7f8a0-559f-499f-835f-0e84a5b7ea59 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:15:10.796993 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2eb7f8a0-559f-499f-835f-0e84a5b7ea59 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:15:10.797418 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2eb7f8a0-559f-499f-835f-0e84a5b7ea59 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:15:10.811252 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.wsgi [None req-2eb7f8a0-559f-499f-835f-0e84a5b7ea59 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] HTTP exception thrown: Instance 5a7a6694-e9a6-4914-a702-51fcc95a5233 could not be found. Aug 11 11:15:10.812812 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-2eb7f8a0-559f-499f-835f-0e84a5b7ea59 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Request method failure captured: Aug 11 11:15:10.812812 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: request: DELETE /compute/v2.1/servers/5a7a6694-e9a6-4914-a702-51fcc95a5233 HTTP/1.1 Aug 11 11:15:10.812812 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Accept: application/json Aug 11 11:15:10.812812 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Accept-Encoding: identity Aug 11 11:15:10.812812 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Connection: close Aug 11 11:15:10.812812 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Content-Length: 0 Aug 11 11:15:10.812812 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Content-Type: application/json Aug 11 11:15:10.812812 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Host: 10.222.0.48 Aug 11 11:15:10.812812 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Openstack-System-Scope: None Aug 11 11:15:10.812812 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: User-Agent: python-urllib3/1.26.11 Aug 11 11:15:10.812812 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Auth-Token: gAAAAABi9ONxPYWpRmadpANSM5f1tl1wVESW1SFE62fiY511YI9uU6D_79r-yuQvgjKjvFqPWeHAiFZFw3kYac2M1zqDX4QPozx6rX_pgfB-Fgz47x90y_mKI7zGyyPs8EkLoYDiomkPvd5a4fE5iPsTlEJ3RRgCL7XDnuCGisjN8PsW1aCU_y4 Aug 11 11:15:10.812812 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Domain-Id: None Aug 11 11:15:10.812812 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Domain-Name: None Aug 11 11:15:10.812812 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Identity-Status: Confirmed Aug 11 11:15:10.812812 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Is-Admin-Project: True Aug 11 11:15:10.812812 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Domain-Id: default Aug 11 11:15:10.812812 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Domain-Name: Default Aug 11 11:15:10.812812 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Id: c56bd2a662e34a6395117027b5c28c5b Aug 11 11:15:10.812812 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Name: tempest-AttachVolumeNegativeTest-848160622 Aug 11 11:15:10.812812 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Role: reader,member Aug 11 11:15:10.812812 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Roles: reader,member Aug 11 11:15:10.814433 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c56bd2a662e34a6395117027b5c28c5b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c56bd2a662e34a6395117027b5c28c5b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c56bd2a662e34a6395117027b5c28c5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c56bd2a662e34a6395117027b5c28c5b", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] Aug 11 11:15:10.814433 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant: tempest-AttachVolumeNegativeTest-848160622 Aug 11 11:15:10.814433 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant-Id: c56bd2a662e34a6395117027b5c28c5b Aug 11 11:15:10.814433 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-848160622 Aug 11 11:15:10.814433 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User: tempest-AttachVolumeNegativeTest-848160622-project Aug 11 11:15:10.814433 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Domain-Id: default Aug 11 11:15:10.814433 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Domain-Name: Default Aug 11 11:15:10.814433 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Id: 08d81bcd5a4f43ce8b4839ee15cb163b Aug 11 11:15:10.814433 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Name: tempest-AttachVolumeNegativeTest-848160622-project Aug 11 11:15:10.814433 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: method: > Aug 11 11:15:10.814433 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: exception: Instance 5a7a6694-e9a6-4914-a702-51fcc95a5233 could not be found. Aug 11 11:15:10.814433 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: action_args: {'id': '5a7a6694-e9a6-4914-a702-51fcc95a5233'} Aug 11 11:15:10.815429 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 11:15:10.815429 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:15:10.815429 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 11:15:10.815429 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 11:15:10.815429 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 11:15:10.815429 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 11:15:10.815429 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 11:15:10.815429 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 11:15:10.815429 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 11:15:10.815429 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 11:15:10.815429 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a7a6694-e9a6-4914-a702-51fcc95a5233 could not be found. Aug 11 11:15:10.815429 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:15:10.815429 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:15:10.815429 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:15:10.815429 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:15:10.815429 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:15:10.815429 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:15:10.815429 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 11:15:10.815429 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 11:15:10.815429 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 11:15:10.817051 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 11:15:10.817051 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 11 11:15:10.817051 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 11 11:15:10.817051 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 11 11:15:10.817051 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 11 11:15:10.817051 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 11:15:10.817051 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 11:15:10.817051 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 11:15:10.817051 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 11:15:10.817051 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a7a6694-e9a6-4914-a702-51fcc95a5233 could not be found. Aug 11 11:15:10.817051 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:15:10.817051 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:15:10.817051 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:15:10.817051 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:15:10.817051 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:15:10.817051 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:15:10.817051 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 11:15:10.817051 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 11:15:10.817051 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a7a6694-e9a6-4914-a702-51fcc95a5233 could not be found. Aug 11 11:15:10.817051 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:15:10.818850 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-2eb7f8a0-559f-499f-835f-0e84a5b7ea59 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Returning 404 to user: Instance 5a7a6694-e9a6-4914-a702-51fcc95a5233 could not be found. {{(pid=121231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 11:15:10.818850 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-2eb7f8a0-559f-499f-835f-0e84a5b7ea59 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "DELETE /compute/v2.1/servers/5a7a6694-e9a6-4914-a702-51fcc95a5233" status: 404 len: 111 microversion: 2.1 time: 0.030634 Aug 11 11:15:10.818850 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 598/1212] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Aug 11 11:15:10 2022] DELETE /compute/v2.1/servers/5a7a6694-e9a6-4914-a702-51fcc95a5233 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 11:15:10.822411 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-662e2a8f-938a-4dde-82e2-0a9eb5969c0b tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:15:10.823026 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-662e2a8f-938a-4dde-82e2-0a9eb5969c0b tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: 5a7a6694-e9a6-4914-a702-51fcc95a5233] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:15:10.829529 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-662e2a8f-938a-4dde-82e2-0a9eb5969c0b tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:15:10.830018 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-662e2a8f-938a-4dde-82e2-0a9eb5969c0b tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:15:10.830453 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-662e2a8f-938a-4dde-82e2-0a9eb5969c0b tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:15:10.831145 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-662e2a8f-938a-4dde-82e2-0a9eb5969c0b tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:15:10.831597 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-662e2a8f-938a-4dde-82e2-0a9eb5969c0b tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:15:10.832051 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-662e2a8f-938a-4dde-82e2-0a9eb5969c0b tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:15:10.845164 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.wsgi [None req-662e2a8f-938a-4dde-82e2-0a9eb5969c0b tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] HTTP exception thrown: Instance 5a7a6694-e9a6-4914-a702-51fcc95a5233 could not be found. Aug 11 11:15:10.847197 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-662e2a8f-938a-4dde-82e2-0a9eb5969c0b tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Request method failure captured: Aug 11 11:15:10.847197 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: request: GET /compute/v2.1/servers/5a7a6694-e9a6-4914-a702-51fcc95a5233 HTTP/1.1 Aug 11 11:15:10.847197 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Accept: application/json Aug 11 11:15:10.847197 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Accept-Encoding: identity Aug 11 11:15:10.847197 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Connection: close Aug 11 11:15:10.847197 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Content-Length: 0 Aug 11 11:15:10.847197 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Content-Type: application/json Aug 11 11:15:10.847197 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Host: 10.222.0.48 Aug 11 11:15:10.847197 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Openstack-System-Scope: None Aug 11 11:15:10.847197 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: User-Agent: python-urllib3/1.26.11 Aug 11 11:15:10.847197 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Auth-Token: gAAAAABi9ONxPYWpRmadpANSM5f1tl1wVESW1SFE62fiY511YI9uU6D_79r-yuQvgjKjvFqPWeHAiFZFw3kYac2M1zqDX4QPozx6rX_pgfB-Fgz47x90y_mKI7zGyyPs8EkLoYDiomkPvd5a4fE5iPsTlEJ3RRgCL7XDnuCGisjN8PsW1aCU_y4 Aug 11 11:15:10.847197 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Domain-Id: None Aug 11 11:15:10.847197 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Domain-Name: None Aug 11 11:15:10.847197 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Identity-Status: Confirmed Aug 11 11:15:10.847197 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Is-Admin-Project: True Aug 11 11:15:10.847197 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Domain-Id: default Aug 11 11:15:10.847197 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Domain-Name: Default Aug 11 11:15:10.847197 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Id: c56bd2a662e34a6395117027b5c28c5b Aug 11 11:15:10.847197 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Name: tempest-AttachVolumeNegativeTest-848160622 Aug 11 11:15:10.847197 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Role: reader,member Aug 11 11:15:10.847197 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Roles: reader,member Aug 11 11:15:10.848838 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c56bd2a662e34a6395117027b5c28c5b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c56bd2a662e34a6395117027b5c28c5b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c56bd2a662e34a6395117027b5c28c5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c56bd2a662e34a6395117027b5c28c5b", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] Aug 11 11:15:10.848838 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Tenant: tempest-AttachVolumeNegativeTest-848160622 Aug 11 11:15:10.848838 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Tenant-Id: c56bd2a662e34a6395117027b5c28c5b Aug 11 11:15:10.848838 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-848160622 Aug 11 11:15:10.848838 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User: tempest-AttachVolumeNegativeTest-848160622-project Aug 11 11:15:10.848838 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Domain-Id: default Aug 11 11:15:10.848838 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Domain-Name: Default Aug 11 11:15:10.848838 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Id: 08d81bcd5a4f43ce8b4839ee15cb163b Aug 11 11:15:10.848838 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Name: tempest-AttachVolumeNegativeTest-848160622-project Aug 11 11:15:10.848838 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: method: > Aug 11 11:15:10.848838 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: exception: Instance 5a7a6694-e9a6-4914-a702-51fcc95a5233 could not be found. Aug 11 11:15:10.848838 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: action_args: {'id': '5a7a6694-e9a6-4914-a702-51fcc95a5233'} Aug 11 11:15:10.849814 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 11:15:10.849814 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:15:10.849814 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 11:15:10.849814 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 11:15:10.849814 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 11:15:10.849814 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 11:15:10.849814 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 11:15:10.849814 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 11:15:10.849814 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 11:15:10.849814 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 11:15:10.849814 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a7a6694-e9a6-4914-a702-51fcc95a5233 could not be found. Aug 11 11:15:10.849814 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:15:10.849814 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:15:10.849814 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:15:10.849814 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:15:10.849814 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:15:10.849814 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:15:10.849814 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 11:15:10.849814 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 11:15:10.849814 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 11:15:10.851565 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 11:15:10.851565 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 11:15:10.851565 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 11:15:10.851565 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 11:15:10.851565 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 11:15:10.851565 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 11:15:10.851565 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 11:15:10.851565 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a7a6694-e9a6-4914-a702-51fcc95a5233 could not be found. Aug 11 11:15:10.851565 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:15:10.851565 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:15:10.851565 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:15:10.851565 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:15:10.851565 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:15:10.851565 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:15:10.851565 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 11:15:10.851565 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 11:15:10.851565 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a7a6694-e9a6-4914-a702-51fcc95a5233 could not be found. Aug 11 11:15:10.851565 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:15:10.852941 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-662e2a8f-938a-4dde-82e2-0a9eb5969c0b tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Returning 404 to user: Instance 5a7a6694-e9a6-4914-a702-51fcc95a5233 could not be found. {{(pid=121232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 11:15:10.852941 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-662e2a8f-938a-4dde-82e2-0a9eb5969c0b tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/5a7a6694-e9a6-4914-a702-51fcc95a5233" status: 404 len: 111 microversion: 2.1 time: 0.030122 Aug 11 11:15:10.852941 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 615/1213] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:15:10 2022] GET /compute/v2.1/servers/5a7a6694-e9a6-4914-a702-51fcc95a5233 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 11 11:15:10.857409 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-554a747e-16dd-47af-ae90-94a27ba8701f tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:15:10.857939 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-554a747e-16dd-47af-ae90-94a27ba8701f tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: fce2ee6c-537a-46d3-978e-92597b2c2931] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:15:10.864545 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-554a747e-16dd-47af-ae90-94a27ba8701f tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:15:10.865046 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-554a747e-16dd-47af-ae90-94a27ba8701f tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:15:10.865476 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-554a747e-16dd-47af-ae90-94a27ba8701f tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:15:10.866159 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-554a747e-16dd-47af-ae90-94a27ba8701f tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:15:10.866608 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-554a747e-16dd-47af-ae90-94a27ba8701f tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:15:10.867028 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-554a747e-16dd-47af-ae90-94a27ba8701f tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:15:10.880211 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.wsgi [None req-554a747e-16dd-47af-ae90-94a27ba8701f tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] HTTP exception thrown: Instance fce2ee6c-537a-46d3-978e-92597b2c2931 could not be found. Aug 11 11:15:10.881751 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-554a747e-16dd-47af-ae90-94a27ba8701f tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Request method failure captured: Aug 11 11:15:10.881751 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: request: DELETE /compute/v2.1/servers/fce2ee6c-537a-46d3-978e-92597b2c2931 HTTP/1.1 Aug 11 11:15:10.881751 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Accept: application/json Aug 11 11:15:10.881751 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Accept-Encoding: identity Aug 11 11:15:10.881751 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Connection: close Aug 11 11:15:10.881751 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Content-Length: 0 Aug 11 11:15:10.881751 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Content-Type: application/json Aug 11 11:15:10.881751 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Host: 10.222.0.48 Aug 11 11:15:10.881751 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Openstack-System-Scope: None Aug 11 11:15:10.881751 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: User-Agent: python-urllib3/1.26.11 Aug 11 11:15:10.881751 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Auth-Token: gAAAAABi9ONxPYWpRmadpANSM5f1tl1wVESW1SFE62fiY511YI9uU6D_79r-yuQvgjKjvFqPWeHAiFZFw3kYac2M1zqDX4QPozx6rX_pgfB-Fgz47x90y_mKI7zGyyPs8EkLoYDiomkPvd5a4fE5iPsTlEJ3RRgCL7XDnuCGisjN8PsW1aCU_y4 Aug 11 11:15:10.881751 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Domain-Id: None Aug 11 11:15:10.881751 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Domain-Name: None Aug 11 11:15:10.881751 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Identity-Status: Confirmed Aug 11 11:15:10.881751 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Is-Admin-Project: True Aug 11 11:15:10.881751 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Domain-Id: default Aug 11 11:15:10.881751 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Domain-Name: Default Aug 11 11:15:10.881751 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Id: c56bd2a662e34a6395117027b5c28c5b Aug 11 11:15:10.881751 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Name: tempest-AttachVolumeNegativeTest-848160622 Aug 11 11:15:10.881751 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Role: reader,member Aug 11 11:15:10.881751 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Roles: reader,member Aug 11 11:15:10.883380 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c56bd2a662e34a6395117027b5c28c5b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c56bd2a662e34a6395117027b5c28c5b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c56bd2a662e34a6395117027b5c28c5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c56bd2a662e34a6395117027b5c28c5b", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] Aug 11 11:15:10.883380 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant: tempest-AttachVolumeNegativeTest-848160622 Aug 11 11:15:10.883380 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant-Id: c56bd2a662e34a6395117027b5c28c5b Aug 11 11:15:10.883380 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-848160622 Aug 11 11:15:10.883380 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User: tempest-AttachVolumeNegativeTest-848160622-project Aug 11 11:15:10.883380 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Domain-Id: default Aug 11 11:15:10.883380 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Domain-Name: Default Aug 11 11:15:10.883380 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Id: 08d81bcd5a4f43ce8b4839ee15cb163b Aug 11 11:15:10.883380 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Name: tempest-AttachVolumeNegativeTest-848160622-project Aug 11 11:15:10.883380 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: method: > Aug 11 11:15:10.883380 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: exception: Instance fce2ee6c-537a-46d3-978e-92597b2c2931 could not be found. Aug 11 11:15:10.883380 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: action_args: {'id': 'fce2ee6c-537a-46d3-978e-92597b2c2931'} Aug 11 11:15:10.884366 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 11:15:10.884366 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:15:10.884366 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 11:15:10.884366 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 11:15:10.884366 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 11:15:10.884366 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 11:15:10.884366 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 11:15:10.884366 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 11:15:10.884366 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 11:15:10.884366 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 11:15:10.884366 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fce2ee6c-537a-46d3-978e-92597b2c2931 could not be found. Aug 11 11:15:10.884366 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:15:10.884366 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:15:10.884366 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:15:10.884366 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:15:10.884366 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:15:10.884366 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:15:10.884366 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 11:15:10.884366 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 11:15:10.884366 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 11:15:10.885907 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 11:15:10.885907 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 11 11:15:10.885907 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 11 11:15:10.885907 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 11 11:15:10.885907 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 11 11:15:10.885907 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 11:15:10.885907 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 11:15:10.885907 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 11:15:10.885907 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 11:15:10.885907 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fce2ee6c-537a-46d3-978e-92597b2c2931 could not be found. Aug 11 11:15:10.885907 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:15:10.885907 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:15:10.885907 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:15:10.885907 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:15:10.885907 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:15:10.885907 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:15:10.885907 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 11:15:10.885907 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 11:15:10.885907 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fce2ee6c-537a-46d3-978e-92597b2c2931 could not be found. Aug 11 11:15:10.885907 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:15:10.887429 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-554a747e-16dd-47af-ae90-94a27ba8701f tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Returning 404 to user: Instance fce2ee6c-537a-46d3-978e-92597b2c2931 could not be found. {{(pid=121231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 11:15:10.887429 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-554a747e-16dd-47af-ae90-94a27ba8701f tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "DELETE /compute/v2.1/servers/fce2ee6c-537a-46d3-978e-92597b2c2931" status: 404 len: 111 microversion: 2.1 time: 0.029725 Aug 11 11:15:10.887429 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 599/1214] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Aug 11 11:15:10 2022] DELETE /compute/v2.1/servers/fce2ee6c-537a-46d3-978e-92597b2c2931 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 11:15:10.891260 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-fe21e0bd-df75-40e4-8db7-5f1e8c0c9d09 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:15:10.891931 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-fe21e0bd-df75-40e4-8db7-5f1e8c0c9d09 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: fce2ee6c-537a-46d3-978e-92597b2c2931] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:15:10.898038 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fe21e0bd-df75-40e4-8db7-5f1e8c0c9d09 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:15:10.898398 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fe21e0bd-df75-40e4-8db7-5f1e8c0c9d09 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:15:10.898807 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fe21e0bd-df75-40e4-8db7-5f1e8c0c9d09 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:15:10.899487 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fe21e0bd-df75-40e4-8db7-5f1e8c0c9d09 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:15:10.899969 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fe21e0bd-df75-40e4-8db7-5f1e8c0c9d09 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:15:10.900396 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-fe21e0bd-df75-40e4-8db7-5f1e8c0c9d09 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:15:10.914211 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.wsgi [None req-fe21e0bd-df75-40e4-8db7-5f1e8c0c9d09 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] HTTP exception thrown: Instance fce2ee6c-537a-46d3-978e-92597b2c2931 could not be found. Aug 11 11:15:10.915783 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-fe21e0bd-df75-40e4-8db7-5f1e8c0c9d09 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Request method failure captured: Aug 11 11:15:10.915783 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: request: GET /compute/v2.1/servers/fce2ee6c-537a-46d3-978e-92597b2c2931 HTTP/1.1 Aug 11 11:15:10.915783 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Accept: application/json Aug 11 11:15:10.915783 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Accept-Encoding: identity Aug 11 11:15:10.915783 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Connection: close Aug 11 11:15:10.915783 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Content-Length: 0 Aug 11 11:15:10.915783 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Content-Type: application/json Aug 11 11:15:10.915783 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Host: 10.222.0.48 Aug 11 11:15:10.915783 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Openstack-System-Scope: None Aug 11 11:15:10.915783 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: User-Agent: python-urllib3/1.26.11 Aug 11 11:15:10.915783 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Auth-Token: gAAAAABi9ONxPYWpRmadpANSM5f1tl1wVESW1SFE62fiY511YI9uU6D_79r-yuQvgjKjvFqPWeHAiFZFw3kYac2M1zqDX4QPozx6rX_pgfB-Fgz47x90y_mKI7zGyyPs8EkLoYDiomkPvd5a4fE5iPsTlEJ3RRgCL7XDnuCGisjN8PsW1aCU_y4 Aug 11 11:15:10.915783 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Domain-Id: None Aug 11 11:15:10.915783 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Domain-Name: None Aug 11 11:15:10.915783 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Identity-Status: Confirmed Aug 11 11:15:10.915783 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Is-Admin-Project: True Aug 11 11:15:10.915783 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Domain-Id: default Aug 11 11:15:10.915783 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Domain-Name: Default Aug 11 11:15:10.915783 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Id: c56bd2a662e34a6395117027b5c28c5b Aug 11 11:15:10.915783 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Name: tempest-AttachVolumeNegativeTest-848160622 Aug 11 11:15:10.915783 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Role: reader,member Aug 11 11:15:10.915783 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Roles: reader,member Aug 11 11:15:10.917468 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c56bd2a662e34a6395117027b5c28c5b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c56bd2a662e34a6395117027b5c28c5b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c56bd2a662e34a6395117027b5c28c5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c56bd2a662e34a6395117027b5c28c5b", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] Aug 11 11:15:10.917468 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Tenant: tempest-AttachVolumeNegativeTest-848160622 Aug 11 11:15:10.917468 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Tenant-Id: c56bd2a662e34a6395117027b5c28c5b Aug 11 11:15:10.917468 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-848160622 Aug 11 11:15:10.917468 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User: tempest-AttachVolumeNegativeTest-848160622-project Aug 11 11:15:10.917468 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Domain-Id: default Aug 11 11:15:10.917468 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Domain-Name: Default Aug 11 11:15:10.917468 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Id: 08d81bcd5a4f43ce8b4839ee15cb163b Aug 11 11:15:10.917468 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Name: tempest-AttachVolumeNegativeTest-848160622-project Aug 11 11:15:10.917468 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: method: > Aug 11 11:15:10.917468 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: exception: Instance fce2ee6c-537a-46d3-978e-92597b2c2931 could not be found. Aug 11 11:15:10.917468 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: action_args: {'id': 'fce2ee6c-537a-46d3-978e-92597b2c2931'} Aug 11 11:15:10.918378 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 11:15:10.918378 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:15:10.918378 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 11:15:10.918378 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 11:15:10.918378 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 11:15:10.918378 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 11:15:10.918378 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 11:15:10.918378 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 11:15:10.918378 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 11:15:10.918378 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 11:15:10.918378 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fce2ee6c-537a-46d3-978e-92597b2c2931 could not be found. Aug 11 11:15:10.918378 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:15:10.918378 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:15:10.918378 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:15:10.918378 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:15:10.918378 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:15:10.918378 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:15:10.918378 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 11:15:10.918378 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 11:15:10.918378 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 11:15:10.920004 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 11:15:10.920004 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 11:15:10.920004 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 11:15:10.920004 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 11:15:10.920004 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 11:15:10.920004 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 11:15:10.920004 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 11:15:10.920004 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fce2ee6c-537a-46d3-978e-92597b2c2931 could not be found. Aug 11 11:15:10.920004 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:15:10.920004 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:15:10.920004 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:15:10.920004 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:15:10.920004 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:15:10.920004 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:15:10.920004 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 11:15:10.920004 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 11:15:10.920004 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fce2ee6c-537a-46d3-978e-92597b2c2931 could not be found. Aug 11 11:15:10.920004 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:15:10.923906 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-fe21e0bd-df75-40e4-8db7-5f1e8c0c9d09 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Returning 404 to user: Instance fce2ee6c-537a-46d3-978e-92597b2c2931 could not be found. {{(pid=121232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 11:15:10.923906 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-fe21e0bd-df75-40e4-8db7-5f1e8c0c9d09 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/fce2ee6c-537a-46d3-978e-92597b2c2931" status: 404 len: 111 microversion: 2.1 time: 0.029696 Aug 11 11:15:10.923906 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 616/1215] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:15:10 2022] GET /compute/v2.1/servers/fce2ee6c-537a-46d3-978e-92597b2c2931 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 11:15:12.317194 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-4433e455-41e3-44b2-b223-e24d554b13b1 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:15:12.317707 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-4433e455-41e3-44b2-b223-e24d554b13b1 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: f6bf35b3-de6a-41ae-81b7-8f45852ab5e2] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:15:12.324143 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4433e455-41e3-44b2-b223-e24d554b13b1 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:15:12.324598 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4433e455-41e3-44b2-b223-e24d554b13b1 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:15:12.325021 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4433e455-41e3-44b2-b223-e24d554b13b1 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:15:12.325702 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4433e455-41e3-44b2-b223-e24d554b13b1 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:15:12.326142 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4433e455-41e3-44b2-b223-e24d554b13b1 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:15:12.326558 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-4433e455-41e3-44b2-b223-e24d554b13b1 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:15:12.341732 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.wsgi [None req-4433e455-41e3-44b2-b223-e24d554b13b1 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] HTTP exception thrown: Instance f6bf35b3-de6a-41ae-81b7-8f45852ab5e2 could not be found. Aug 11 11:15:12.343233 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-4433e455-41e3-44b2-b223-e24d554b13b1 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Request method failure captured: Aug 11 11:15:12.343233 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: request: DELETE /compute/v2.1/servers/f6bf35b3-de6a-41ae-81b7-8f45852ab5e2 HTTP/1.1 Aug 11 11:15:12.343233 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Accept: application/json Aug 11 11:15:12.343233 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Accept-Encoding: identity Aug 11 11:15:12.343233 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Connection: close Aug 11 11:15:12.343233 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Content-Length: 0 Aug 11 11:15:12.343233 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Content-Type: application/json Aug 11 11:15:12.343233 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Host: 10.222.0.48 Aug 11 11:15:12.343233 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Openstack-System-Scope: None Aug 11 11:15:12.343233 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: User-Agent: python-urllib3/1.26.11 Aug 11 11:15:12.343233 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Auth-Token: gAAAAABi9ONxPYWpRmadpANSM5f1tl1wVESW1SFE62fiY511YI9uU6D_79r-yuQvgjKjvFqPWeHAiFZFw3kYac2M1zqDX4QPozx6rX_pgfB-Fgz47x90y_mKI7zGyyPs8EkLoYDiomkPvd5a4fE5iPsTlEJ3RRgCL7XDnuCGisjN8PsW1aCU_y4 Aug 11 11:15:12.343233 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Domain-Id: None Aug 11 11:15:12.343233 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Domain-Name: None Aug 11 11:15:12.343233 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Identity-Status: Confirmed Aug 11 11:15:12.343233 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Is-Admin-Project: True Aug 11 11:15:12.343233 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Domain-Id: default Aug 11 11:15:12.343233 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Domain-Name: Default Aug 11 11:15:12.343233 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Id: c56bd2a662e34a6395117027b5c28c5b Aug 11 11:15:12.343233 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Name: tempest-AttachVolumeNegativeTest-848160622 Aug 11 11:15:12.343233 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Role: reader,member Aug 11 11:15:12.343233 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Roles: reader,member Aug 11 11:15:12.344941 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c56bd2a662e34a6395117027b5c28c5b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c56bd2a662e34a6395117027b5c28c5b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c56bd2a662e34a6395117027b5c28c5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c56bd2a662e34a6395117027b5c28c5b", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] Aug 11 11:15:12.344941 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant: tempest-AttachVolumeNegativeTest-848160622 Aug 11 11:15:12.344941 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant-Id: c56bd2a662e34a6395117027b5c28c5b Aug 11 11:15:12.344941 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-848160622 Aug 11 11:15:12.344941 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User: tempest-AttachVolumeNegativeTest-848160622-project Aug 11 11:15:12.344941 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Domain-Id: default Aug 11 11:15:12.344941 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Domain-Name: Default Aug 11 11:15:12.344941 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Id: 08d81bcd5a4f43ce8b4839ee15cb163b Aug 11 11:15:12.344941 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Name: tempest-AttachVolumeNegativeTest-848160622-project Aug 11 11:15:12.344941 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: method: > Aug 11 11:15:12.344941 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: exception: Instance f6bf35b3-de6a-41ae-81b7-8f45852ab5e2 could not be found. Aug 11 11:15:12.344941 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: action_args: {'id': 'f6bf35b3-de6a-41ae-81b7-8f45852ab5e2'} Aug 11 11:15:12.345771 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 11:15:12.345771 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:15:12.345771 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 11:15:12.345771 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 11:15:12.345771 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 11:15:12.345771 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 11:15:12.345771 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 11:15:12.345771 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 11:15:12.345771 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 11:15:12.345771 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 11:15:12.345771 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6bf35b3-de6a-41ae-81b7-8f45852ab5e2 could not be found. Aug 11 11:15:12.345771 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:15:12.345771 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:15:12.345771 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:15:12.345771 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:15:12.345771 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:15:12.345771 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:15:12.345771 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 11:15:12.345771 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 11:15:12.345771 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 11:15:12.347616 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 11:15:12.347616 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 11 11:15:12.347616 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 11 11:15:12.347616 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 11 11:15:12.347616 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 11 11:15:12.347616 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 11:15:12.347616 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 11:15:12.347616 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 11:15:12.347616 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 11:15:12.347616 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6bf35b3-de6a-41ae-81b7-8f45852ab5e2 could not be found. Aug 11 11:15:12.347616 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:15:12.347616 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:15:12.347616 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:15:12.347616 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:15:12.347616 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:15:12.347616 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:15:12.347616 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 11:15:12.347616 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 11:15:12.347616 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6bf35b3-de6a-41ae-81b7-8f45852ab5e2 could not be found. Aug 11 11:15:12.347616 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:15:12.349210 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-4433e455-41e3-44b2-b223-e24d554b13b1 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Returning 404 to user: Instance f6bf35b3-de6a-41ae-81b7-8f45852ab5e2 could not be found. {{(pid=121231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 11:15:12.349210 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-4433e455-41e3-44b2-b223-e24d554b13b1 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f6bf35b3-de6a-41ae-81b7-8f45852ab5e2" status: 404 len: 111 microversion: 2.1 time: 0.031302 Aug 11 11:15:12.349210 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 600/1216] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Aug 11 11:15:12 2022] DELETE /compute/v2.1/servers/f6bf35b3-de6a-41ae-81b7-8f45852ab5e2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 11:15:12.353777 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-69685c2a-c533-4e30-bb50-b9845eb4a663 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:15:12.354384 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-69685c2a-c533-4e30-bb50-b9845eb4a663 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] [instance: f6bf35b3-de6a-41ae-81b7-8f45852ab5e2] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:15:12.360697 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-69685c2a-c533-4e30-bb50-b9845eb4a663 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:15:12.361195 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-69685c2a-c533-4e30-bb50-b9845eb4a663 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:15:12.361632 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-69685c2a-c533-4e30-bb50-b9845eb4a663 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:15:12.363000 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-69685c2a-c533-4e30-bb50-b9845eb4a663 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:15:12.363450 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-69685c2a-c533-4e30-bb50-b9845eb4a663 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:15:12.363906 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-69685c2a-c533-4e30-bb50-b9845eb4a663 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:15:12.376981 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.wsgi [None req-69685c2a-c533-4e30-bb50-b9845eb4a663 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] HTTP exception thrown: Instance f6bf35b3-de6a-41ae-81b7-8f45852ab5e2 could not be found. Aug 11 11:15:12.378476 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-69685c2a-c533-4e30-bb50-b9845eb4a663 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Request method failure captured: Aug 11 11:15:12.378476 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: request: GET /compute/v2.1/servers/f6bf35b3-de6a-41ae-81b7-8f45852ab5e2 HTTP/1.1 Aug 11 11:15:12.378476 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Accept: application/json Aug 11 11:15:12.378476 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Accept-Encoding: identity Aug 11 11:15:12.378476 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Connection: close Aug 11 11:15:12.378476 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Content-Length: 0 Aug 11 11:15:12.378476 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Content-Type: application/json Aug 11 11:15:12.378476 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Host: 10.222.0.48 Aug 11 11:15:12.378476 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Openstack-System-Scope: None Aug 11 11:15:12.378476 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: User-Agent: python-urllib3/1.26.11 Aug 11 11:15:12.378476 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Auth-Token: gAAAAABi9ONxPYWpRmadpANSM5f1tl1wVESW1SFE62fiY511YI9uU6D_79r-yuQvgjKjvFqPWeHAiFZFw3kYac2M1zqDX4QPozx6rX_pgfB-Fgz47x90y_mKI7zGyyPs8EkLoYDiomkPvd5a4fE5iPsTlEJ3RRgCL7XDnuCGisjN8PsW1aCU_y4 Aug 11 11:15:12.378476 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Domain-Id: None Aug 11 11:15:12.378476 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Domain-Name: None Aug 11 11:15:12.378476 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Identity-Status: Confirmed Aug 11 11:15:12.378476 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Is-Admin-Project: True Aug 11 11:15:12.378476 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Domain-Id: default Aug 11 11:15:12.378476 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Domain-Name: Default Aug 11 11:15:12.378476 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Id: c56bd2a662e34a6395117027b5c28c5b Aug 11 11:15:12.378476 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Name: tempest-AttachVolumeNegativeTest-848160622 Aug 11 11:15:12.378476 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Role: reader,member Aug 11 11:15:12.378476 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Roles: reader,member Aug 11 11:15:12.380196 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c56bd2a662e34a6395117027b5c28c5b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/c56bd2a662e34a6395117027b5c28c5b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/c56bd2a662e34a6395117027b5c28c5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_c56bd2a662e34a6395117027b5c28c5b", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] Aug 11 11:15:12.380196 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Tenant: tempest-AttachVolumeNegativeTest-848160622 Aug 11 11:15:12.380196 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Tenant-Id: c56bd2a662e34a6395117027b5c28c5b Aug 11 11:15:12.380196 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-848160622 Aug 11 11:15:12.380196 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User: tempest-AttachVolumeNegativeTest-848160622-project Aug 11 11:15:12.380196 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Domain-Id: default Aug 11 11:15:12.380196 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Domain-Name: Default Aug 11 11:15:12.380196 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Id: 08d81bcd5a4f43ce8b4839ee15cb163b Aug 11 11:15:12.380196 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Name: tempest-AttachVolumeNegativeTest-848160622-project Aug 11 11:15:12.380196 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: method: > Aug 11 11:15:12.380196 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: exception: Instance f6bf35b3-de6a-41ae-81b7-8f45852ab5e2 could not be found. Aug 11 11:15:12.380196 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: action_args: {'id': 'f6bf35b3-de6a-41ae-81b7-8f45852ab5e2'} Aug 11 11:15:12.381491 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 11:15:12.381491 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:15:12.381491 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 11:15:12.381491 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 11:15:12.381491 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 11:15:12.381491 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 11:15:12.381491 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 11:15:12.381491 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 11:15:12.381491 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 11:15:12.381491 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 11:15:12.381491 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f6bf35b3-de6a-41ae-81b7-8f45852ab5e2 could not be found. Aug 11 11:15:12.381491 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:15:12.381491 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:15:12.381491 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:15:12.381491 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:15:12.381491 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:15:12.381491 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:15:12.381491 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 11:15:12.381491 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 11:15:12.381491 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 11:15:12.383077 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 11:15:12.383077 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 11:15:12.383077 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 11:15:12.383077 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 11:15:12.383077 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 11:15:12.383077 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 11:15:12.383077 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 11:15:12.383077 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f6bf35b3-de6a-41ae-81b7-8f45852ab5e2 could not be found. Aug 11 11:15:12.383077 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:15:12.383077 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:15:12.383077 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:15:12.383077 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:15:12.383077 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:15:12.383077 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:15:12.383077 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 11:15:12.383077 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 11:15:12.383077 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f6bf35b3-de6a-41ae-81b7-8f45852ab5e2 could not be found. Aug 11 11:15:12.383077 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:15:12.384488 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-69685c2a-c533-4e30-bb50-b9845eb4a663 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] Returning 404 to user: Instance f6bf35b3-de6a-41ae-81b7-8f45852ab5e2 could not be found. {{(pid=121232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 11:15:12.384488 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-69685c2a-c533-4e30-bb50-b9845eb4a663 tempest-AttachVolumeNegativeTest-848160622 tempest-AttachVolumeNegativeTest-848160622-project] 10.222.0.48 "GET /compute/v2.1/servers/f6bf35b3-de6a-41ae-81b7-8f45852ab5e2" status: 404 len: 111 microversion: 2.1 time: 0.030200 Aug 11 11:15:12.384488 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 617/1217] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:15:12 2022] GET /compute/v2.1/servers/f6bf35b3-de6a-41ae-81b7-8f45852ab5e2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 11:16:15.954479 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:16:15.957739 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_api:SELECT=22,nova_api:DELETE=1 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:16:15.958160 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG dbcounter [-] [121231] Writing DB stats nova_cell1:SELECT=46,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:16:15.958284 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG dbcounter [-] [121232] Writing DB stats nova_cell1:SELECT=39 {{(pid=121232) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 11:16:15.960382 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [req-640059cd-704c-4ab1-b80a-7ec9ba9cf467 req-b607ea5d-0d52-476c-ab47-7cb3bb7d898e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fba9bf9-84fb-45fd-b07c-9b9d796c486a", "tag": "9f18d0a0-0718-48ba-a282-185e93527632"}]} {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:16:15.960537 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-e1c78826-202e-416e-b124-d0f2733be800 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:16:15.960995 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-e1c78826-202e-416e-b124-d0f2733be800 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: 6fba9bf9-84fb-45fd-b07c-9b9d796c486a] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:16:15.967098 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e1c78826-202e-416e-b124-d0f2733be800 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:16:15.967603 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e1c78826-202e-416e-b124-d0f2733be800 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:16:15.968066 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e1c78826-202e-416e-b124-d0f2733be800 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:16:15.968781 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e1c78826-202e-416e-b124-d0f2733be800 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:16:15.969225 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e1c78826-202e-416e-b124-d0f2733be800 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:16:15.969659 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-e1c78826-202e-416e-b124-d0f2733be800 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:16:15.979448 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-640059cd-704c-4ab1-b80a-7ec9ba9cf467 req-b607ea5d-0d52-476c-ab47-7cb3bb7d898e service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:16:15.979954 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-640059cd-704c-4ab1-b80a-7ec9ba9cf467 req-b607ea5d-0d52-476c-ab47-7cb3bb7d898e service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:16:15.980383 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [req-640059cd-704c-4ab1-b80a-7ec9ba9cf467 req-b607ea5d-0d52-476c-ab47-7cb3bb7d898e service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:16:15.992596 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.compute.server_external_events [req-640059cd-704c-4ab1-b80a-7ec9ba9cf467 req-b607ea5d-0d52-476c-ab47-7cb3bb7d898e service nova] Creating event network-changed:9f18d0a0-0718-48ba-a282-185e93527632 for instance 6fba9bf9-84fb-45fd-b07c-9b9d796c486a on hv-cinder-82002 Aug 11 11:16:15.996829 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-e1c78826-202e-416e-b124-d0f2733be800 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: 6fba9bf9-84fb-45fd-b07c-9b9d796c486a] Going to try to terminate instance {{(pid=121231) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 11 11:16:15.997992 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [req-640059cd-704c-4ab1-b80a-7ec9ba9cf467 req-b607ea5d-0d52-476c-ab47-7cb3bb7d898e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044019 Aug 11 11:16:15.998913 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 618/1218] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:16:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 11:16:16.247446 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-e1c78826-202e-416e-b124-d0f2733be800 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "DELETE /compute/v2.1/servers/6fba9bf9-84fb-45fd-b07c-9b9d796c486a" status: 204 len: 0 microversion: 2.1 time: 0.294024 Aug 11 11:16:16.249722 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 601/1219] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Aug 11 11:16:15 2022] DELETE /compute/v2.1/servers/6fba9bf9-84fb-45fd-b07c-9b9d796c486a => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 11 11:16:16.267799 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-2e3432a2-672a-422a-8115-9598e39db598 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:16:16.269029 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-2e3432a2-672a-422a-8115-9598e39db598 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: 6fba9bf9-84fb-45fd-b07c-9b9d796c486a] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:16:16.278872 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2e3432a2-672a-422a-8115-9598e39db598 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:16:16.282181 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2e3432a2-672a-422a-8115-9598e39db598 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:16:16.282181 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2e3432a2-672a-422a-8115-9598e39db598 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:16:16.282181 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2e3432a2-672a-422a-8115-9598e39db598 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:16:16.282181 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2e3432a2-672a-422a-8115-9598e39db598 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:16:16.283646 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-2e3432a2-672a-422a-8115-9598e39db598 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:16:16.435683 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-2e3432a2-672a-422a-8115-9598e39db598 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9dbe3b7fdd482681b6ab94c26f4e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d394882f294c6283721bcc6f8ff04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:16:16.444202 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-2e3432a2-672a-422a-8115-9598e39db598 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "GET /compute/v2.1/servers/6fba9bf9-84fb-45fd-b07c-9b9d796c486a" status: 200 len: 1577 microversion: 2.1 time: 0.183821 Aug 11 11:16:16.458532 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 619/1220] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:16:16 2022] GET /compute/v2.1/servers/6fba9bf9-84fb-45fd-b07c-9b9d796c486a => generated 1577 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:16:17.466845 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-f9f2fb56-a1c2-43df-8f4d-9014539245c2 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:16:17.467544 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-f9f2fb56-a1c2-43df-8f4d-9014539245c2 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: 6fba9bf9-84fb-45fd-b07c-9b9d796c486a] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:16:17.474989 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f9f2fb56-a1c2-43df-8f4d-9014539245c2 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:16:17.475472 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f9f2fb56-a1c2-43df-8f4d-9014539245c2 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:16:17.475937 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f9f2fb56-a1c2-43df-8f4d-9014539245c2 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:16:17.476621 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f9f2fb56-a1c2-43df-8f4d-9014539245c2 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:16:17.477069 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f9f2fb56-a1c2-43df-8f4d-9014539245c2 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:16:17.477488 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-f9f2fb56-a1c2-43df-8f4d-9014539245c2 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:16:17.613554 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-f9f2fb56-a1c2-43df-8f4d-9014539245c2 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9dbe3b7fdd482681b6ab94c26f4e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d394882f294c6283721bcc6f8ff04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:16:17.621455 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-f9f2fb56-a1c2-43df-8f4d-9014539245c2 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "GET /compute/v2.1/servers/6fba9bf9-84fb-45fd-b07c-9b9d796c486a" status: 200 len: 1577 microversion: 2.1 time: 0.159104 Aug 11 11:16:17.622014 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 602/1221] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:16:17 2022] GET /compute/v2.1/servers/6fba9bf9-84fb-45fd-b07c-9b9d796c486a => generated 1577 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:16:18.643372 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-b3611c52-fe17-41ce-b362-349d58180c15 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:16:18.644079 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-b3611c52-fe17-41ce-b362-349d58180c15 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: 6fba9bf9-84fb-45fd-b07c-9b9d796c486a] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:16:18.651116 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b3611c52-fe17-41ce-b362-349d58180c15 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:16:18.651681 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b3611c52-fe17-41ce-b362-349d58180c15 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:16:18.652259 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b3611c52-fe17-41ce-b362-349d58180c15 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:16:18.653041 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b3611c52-fe17-41ce-b362-349d58180c15 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:16:18.653705 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b3611c52-fe17-41ce-b362-349d58180c15 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:16:18.654227 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b3611c52-fe17-41ce-b362-349d58180c15 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:16:18.789800 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-b3611c52-fe17-41ce-b362-349d58180c15 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9dbe3b7fdd482681b6ab94c26f4e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d394882f294c6283721bcc6f8ff04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:16:18.797529 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-b3611c52-fe17-41ce-b362-349d58180c15 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "GET /compute/v2.1/servers/6fba9bf9-84fb-45fd-b07c-9b9d796c486a" status: 200 len: 1458 microversion: 2.1 time: 0.158848 Aug 11 11:16:18.798099 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 620/1222] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:16:18 2022] GET /compute/v2.1/servers/6fba9bf9-84fb-45fd-b07c-9b9d796c486a => generated 1458 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:16:19.028581 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-b1d9b64d-cb25-4f03-a0d3-68fe3b71bbb0 req-fcc4031f-ce46-4a8e-b95e-7e23385aa3aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fba9bf9-84fb-45fd-b07c-9b9d796c486a", "name": "network-vif-deleted", "tag": "9f18d0a0-0718-48ba-a282-185e93527632"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:16:19.038890 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-b1d9b64d-cb25-4f03-a0d3-68fe3b71bbb0 req-fcc4031f-ce46-4a8e-b95e-7e23385aa3aa service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:16:19.039386 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-b1d9b64d-cb25-4f03-a0d3-68fe3b71bbb0 req-fcc4031f-ce46-4a8e-b95e-7e23385aa3aa service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:16:19.039869 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-b1d9b64d-cb25-4f03-a0d3-68fe3b71bbb0 req-fcc4031f-ce46-4a8e-b95e-7e23385aa3aa service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:16:19.050680 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-b1d9b64d-cb25-4f03-a0d3-68fe3b71bbb0 req-fcc4031f-ce46-4a8e-b95e-7e23385aa3aa service nova] Creating event network-vif-deleted:9f18d0a0-0718-48ba-a282-185e93527632 for instance 6fba9bf9-84fb-45fd-b07c-9b9d796c486a on hv-cinder-82002 Aug 11 11:16:19.055798 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-b1d9b64d-cb25-4f03-a0d3-68fe3b71bbb0 req-fcc4031f-ce46-4a8e-b95e-7e23385aa3aa service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030963 Aug 11 11:16:19.056565 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 603/1223] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:16:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:16:19.818946 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-6a49df1b-851d-4743-bacb-1a527520709f tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:16:19.819553 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-6a49df1b-851d-4743-bacb-1a527520709f tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: 6fba9bf9-84fb-45fd-b07c-9b9d796c486a] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:16:19.825954 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6a49df1b-851d-4743-bacb-1a527520709f tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:16:19.826434 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6a49df1b-851d-4743-bacb-1a527520709f tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:16:19.826872 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6a49df1b-851d-4743-bacb-1a527520709f tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:16:19.827555 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6a49df1b-851d-4743-bacb-1a527520709f tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:16:19.828039 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6a49df1b-851d-4743-bacb-1a527520709f tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:16:19.828463 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6a49df1b-851d-4743-bacb-1a527520709f tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:16:19.859982 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6a49df1b-851d-4743-bacb-1a527520709f tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:16:19.860458 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6a49df1b-851d-4743-bacb-1a527520709f tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:16:19.860821 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-6a49df1b-851d-4743-bacb-1a527520709f tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:16:19.861267 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.objects.instance [None req-6a49df1b-851d-4743-bacb-1a527520709f tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lazy-loading 'fault' on Instance uuid 6fba9bf9-84fb-45fd-b07c-9b9d796c486a {{(pid=121232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 11:16:19.903260 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-6a49df1b-851d-4743-bacb-1a527520709f tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9dbe3b7fdd482681b6ab94c26f4e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d394882f294c6283721bcc6f8ff04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:16:19.911161 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-6a49df1b-851d-4743-bacb-1a527520709f tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "GET /compute/v2.1/servers/6fba9bf9-84fb-45fd-b07c-9b9d796c486a" status: 200 len: 1230 microversion: 2.1 time: 0.096575 Aug 11 11:16:19.911729 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 621/1224] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:16:19 2022] GET /compute/v2.1/servers/6fba9bf9-84fb-45fd-b07c-9b9d796c486a => generated 1230 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:16:20.933487 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-5d6513d0-0884-4ab0-8287-2dce0cadd561 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:16:20.934203 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-5d6513d0-0884-4ab0-8287-2dce0cadd561 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: 6fba9bf9-84fb-45fd-b07c-9b9d796c486a] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:16:20.940540 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5d6513d0-0884-4ab0-8287-2dce0cadd561 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:16:20.941023 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5d6513d0-0884-4ab0-8287-2dce0cadd561 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:16:20.941457 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5d6513d0-0884-4ab0-8287-2dce0cadd561 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:16:20.942170 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5d6513d0-0884-4ab0-8287-2dce0cadd561 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:16:20.942619 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5d6513d0-0884-4ab0-8287-2dce0cadd561 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:16:20.943044 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-5d6513d0-0884-4ab0-8287-2dce0cadd561 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:16:20.956683 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.wsgi [None req-5d6513d0-0884-4ab0-8287-2dce0cadd561 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] HTTP exception thrown: Instance 6fba9bf9-84fb-45fd-b07c-9b9d796c486a could not be found. Aug 11 11:16:20.958277 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-5d6513d0-0884-4ab0-8287-2dce0cadd561 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Request method failure captured: Aug 11 11:16:20.958277 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: request: GET /compute/v2.1/servers/6fba9bf9-84fb-45fd-b07c-9b9d796c486a HTTP/1.1 Aug 11 11:16:20.958277 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Accept: application/json Aug 11 11:16:20.958277 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Accept-Encoding: identity Aug 11 11:16:20.958277 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Connection: close Aug 11 11:16:20.958277 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Content-Length: 0 Aug 11 11:16:20.958277 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Content-Type: application/json Aug 11 11:16:20.958277 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Host: 10.222.0.48 Aug 11 11:16:20.958277 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Openstack-System-Scope: None Aug 11 11:16:20.958277 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: User-Agent: python-urllib3/1.26.11 Aug 11 11:16:20.958277 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Auth-Token: gAAAAABi9ONDFF-ves-CEGtHwEi0XWUKyyde7tb-EmhLfOVMkLk-S6BaYvZIZyro-ToFwRU2ksjzyOGpMhm8jPNnMcZc2yErCXhJsj5bK4F2r0o8vxP0k2UPPpT-E6--5k2jWa36MkdUrOHa4cUapXKrNjZGlMmImRY0M-OdlgiV64MA5NWcgec Aug 11 11:16:20.958277 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Domain-Id: None Aug 11 11:16:20.958277 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Domain-Name: None Aug 11 11:16:20.958277 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Identity-Status: Confirmed Aug 11 11:16:20.958277 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Is-Admin-Project: True Aug 11 11:16:20.958277 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Domain-Id: default Aug 11 11:16:20.958277 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Domain-Name: Default Aug 11 11:16:20.958277 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Id: b1d394882f294c6283721bcc6f8ff04d Aug 11 11:16:20.958277 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Name: tempest-TestVolumeBootPattern-469230006 Aug 11 11:16:20.958277 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Role: reader,member Aug 11 11:16:20.958277 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Roles: reader,member Aug 11 11:16:20.960094 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b1d394882f294c6283721bcc6f8ff04d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b1d394882f294c6283721bcc6f8ff04d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b1d394882f294c6283721bcc6f8ff04d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b1d394882f294c6283721bcc6f8ff04d", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] Aug 11 11:16:20.960094 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant: tempest-TestVolumeBootPattern-469230006 Aug 11 11:16:20.960094 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant-Id: b1d394882f294c6283721bcc6f8ff04d Aug 11 11:16:20.960094 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant-Name: tempest-TestVolumeBootPattern-469230006 Aug 11 11:16:20.960094 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User: tempest-TestVolumeBootPattern-469230006-project Aug 11 11:16:20.960094 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Domain-Id: default Aug 11 11:16:20.960094 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Domain-Name: Default Aug 11 11:16:20.960094 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Id: 2a9dbe3b7fdd482681b6ab94c26f4e71 Aug 11 11:16:20.960094 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Name: tempest-TestVolumeBootPattern-469230006-project Aug 11 11:16:20.960094 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: method: > Aug 11 11:16:20.960094 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: exception: Instance 6fba9bf9-84fb-45fd-b07c-9b9d796c486a could not be found. Aug 11 11:16:20.960094 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: action_args: {'id': '6fba9bf9-84fb-45fd-b07c-9b9d796c486a'} Aug 11 11:16:20.961266 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 11:16:20.961266 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:16:20.961266 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 11:16:20.961266 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 11:16:20.961266 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 11:16:20.961266 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 11:16:20.961266 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 11:16:20.961266 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 11:16:20.961266 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 11:16:20.961266 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 11:16:20.961266 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fba9bf9-84fb-45fd-b07c-9b9d796c486a could not be found. Aug 11 11:16:20.961266 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:16:20.961266 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:16:20.961266 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:16:20.961266 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:16:20.961266 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:16:20.961266 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:16:20.961266 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 11:16:20.961266 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 11:16:20.961266 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 11:16:20.962989 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 11:16:20.962989 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 11:16:20.962989 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 11:16:20.962989 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 11:16:20.962989 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 11:16:20.962989 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 11:16:20.962989 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 11:16:20.962989 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fba9bf9-84fb-45fd-b07c-9b9d796c486a could not be found. Aug 11 11:16:20.962989 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:16:20.962989 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:16:20.962989 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:16:20.962989 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:16:20.962989 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:16:20.962989 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:16:20.962989 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 11:16:20.962989 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 11:16:20.962989 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fba9bf9-84fb-45fd-b07c-9b9d796c486a could not be found. Aug 11 11:16:20.962989 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:16:20.964646 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-5d6513d0-0884-4ab0-8287-2dce0cadd561 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Returning 404 to user: Instance 6fba9bf9-84fb-45fd-b07c-9b9d796c486a could not be found. {{(pid=121231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 11:16:20.964646 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-5d6513d0-0884-4ab0-8287-2dce0cadd561 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "GET /compute/v2.1/servers/6fba9bf9-84fb-45fd-b07c-9b9d796c486a" status: 404 len: 111 microversion: 2.1 time: 0.031004 Aug 11 11:16:20.964646 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 604/1225] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:16:20 2022] GET /compute/v2.1/servers/6fba9bf9-84fb-45fd-b07c-9b9d796c486a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 11:16:26.544775 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-e697274a-dd2a-4776-84ca-7dc869c064e1 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:16:26.545502 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-e697274a-dd2a-4776-84ca-7dc869c064e1 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: 6775b84f-c318-4b37-9fdf-e93e607dfa4e] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:16:26.545788 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-d60539fb-a503-4337-ae40-bf3ca2686b33 req-92344063-ba98-4b74-90d7-65263b9f74f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6775b84f-c318-4b37-9fdf-e93e607dfa4e", "tag": "05193d12-2729-4079-9c68-2950747232ad"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:16:26.553383 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e697274a-dd2a-4776-84ca-7dc869c064e1 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:16:26.554020 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e697274a-dd2a-4776-84ca-7dc869c064e1 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:16:26.554701 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e697274a-dd2a-4776-84ca-7dc869c064e1 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:16:26.555511 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e697274a-dd2a-4776-84ca-7dc869c064e1 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:16:26.556175 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-d60539fb-a503-4337-ae40-bf3ca2686b33 req-92344063-ba98-4b74-90d7-65263b9f74f5 service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:16:26.556307 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e697274a-dd2a-4776-84ca-7dc869c064e1 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:16:26.556651 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-d60539fb-a503-4337-ae40-bf3ca2686b33 req-92344063-ba98-4b74-90d7-65263b9f74f5 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:16:26.556958 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-e697274a-dd2a-4776-84ca-7dc869c064e1 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:16:26.557068 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-d60539fb-a503-4337-ae40-bf3ca2686b33 req-92344063-ba98-4b74-90d7-65263b9f74f5 service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:16:26.569729 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-d60539fb-a503-4337-ae40-bf3ca2686b33 req-92344063-ba98-4b74-90d7-65263b9f74f5 service nova] Creating event network-changed:05193d12-2729-4079-9c68-2950747232ad for instance 6775b84f-c318-4b37-9fdf-e93e607dfa4e on hv-cinder-82002 Aug 11 11:16:26.575339 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-d60539fb-a503-4337-ae40-bf3ca2686b33 req-92344063-ba98-4b74-90d7-65263b9f74f5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033157 Aug 11 11:16:26.576824 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 605/1226] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:16:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 11:16:26.585251 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-e697274a-dd2a-4776-84ca-7dc869c064e1 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: 6775b84f-c318-4b37-9fdf-e93e607dfa4e] Going to try to terminate instance {{(pid=121232) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 11 11:16:26.900043 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-e697274a-dd2a-4776-84ca-7dc869c064e1 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "DELETE /compute/v2.1/servers/6775b84f-c318-4b37-9fdf-e93e607dfa4e" status: 204 len: 0 microversion: 2.1 time: 0.359694 Aug 11 11:16:26.900646 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 622/1227] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Aug 11 11:16:26 2022] DELETE /compute/v2.1/servers/6775b84f-c318-4b37-9fdf-e93e607dfa4e => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 11 11:16:26.909849 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-fa08f5e6-c996-4244-b942-d784e30ad509 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:16:26.910559 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-fa08f5e6-c996-4244-b942-d784e30ad509 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: 6775b84f-c318-4b37-9fdf-e93e607dfa4e] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:16:26.917820 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fa08f5e6-c996-4244-b942-d784e30ad509 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:16:26.918313 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fa08f5e6-c996-4244-b942-d784e30ad509 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:16:26.918751 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fa08f5e6-c996-4244-b942-d784e30ad509 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:16:26.919458 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fa08f5e6-c996-4244-b942-d784e30ad509 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:16:26.919952 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fa08f5e6-c996-4244-b942-d784e30ad509 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:16:26.920438 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-fa08f5e6-c996-4244-b942-d784e30ad509 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:16:27.055608 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-fa08f5e6-c996-4244-b942-d784e30ad509 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9dbe3b7fdd482681b6ab94c26f4e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d394882f294c6283721bcc6f8ff04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:16:27.063558 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-fa08f5e6-c996-4244-b942-d784e30ad509 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "GET /compute/v2.1/servers/6775b84f-c318-4b37-9fdf-e93e607dfa4e" status: 200 len: 1578 microversion: 2.1 time: 0.158099 Aug 11 11:16:27.064169 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 606/1228] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:16:26 2022] GET /compute/v2.1/servers/6775b84f-c318-4b37-9fdf-e93e607dfa4e => generated 1578 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:16:28.085777 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-93458caf-7f84-44fd-bba2-04e212c43e94 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:16:28.086431 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-93458caf-7f84-44fd-bba2-04e212c43e94 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: 6775b84f-c318-4b37-9fdf-e93e607dfa4e] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:16:28.092833 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-93458caf-7f84-44fd-bba2-04e212c43e94 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:16:28.093310 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-93458caf-7f84-44fd-bba2-04e212c43e94 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:16:28.093752 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-93458caf-7f84-44fd-bba2-04e212c43e94 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:16:28.094442 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-93458caf-7f84-44fd-bba2-04e212c43e94 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:16:28.094894 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-93458caf-7f84-44fd-bba2-04e212c43e94 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:16:28.095319 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-93458caf-7f84-44fd-bba2-04e212c43e94 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:16:28.232138 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-93458caf-7f84-44fd-bba2-04e212c43e94 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9dbe3b7fdd482681b6ab94c26f4e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d394882f294c6283721bcc6f8ff04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:16:28.241363 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-93458caf-7f84-44fd-bba2-04e212c43e94 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "GET /compute/v2.1/servers/6775b84f-c318-4b37-9fdf-e93e607dfa4e" status: 200 len: 1578 microversion: 2.1 time: 0.159952 Aug 11 11:16:28.241930 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 623/1229] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:16:28 2022] GET /compute/v2.1/servers/6775b84f-c318-4b37-9fdf-e93e607dfa4e => generated 1578 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:16:29.263888 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-c4df2f21-05b4-4c57-bd39-a001959c5bfe tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:16:29.264674 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-c4df2f21-05b4-4c57-bd39-a001959c5bfe tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: 6775b84f-c318-4b37-9fdf-e93e607dfa4e] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:16:29.274915 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c4df2f21-05b4-4c57-bd39-a001959c5bfe tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:16:29.274915 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c4df2f21-05b4-4c57-bd39-a001959c5bfe tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:16:29.274915 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c4df2f21-05b4-4c57-bd39-a001959c5bfe tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:16:29.274915 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c4df2f21-05b4-4c57-bd39-a001959c5bfe tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:16:29.275291 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c4df2f21-05b4-4c57-bd39-a001959c5bfe tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:16:29.275291 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-c4df2f21-05b4-4c57-bd39-a001959c5bfe tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:16:29.407320 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-c4df2f21-05b4-4c57-bd39-a001959c5bfe tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9dbe3b7fdd482681b6ab94c26f4e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d394882f294c6283721bcc6f8ff04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:16:29.414824 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-c4df2f21-05b4-4c57-bd39-a001959c5bfe tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "GET /compute/v2.1/servers/6775b84f-c318-4b37-9fdf-e93e607dfa4e" status: 200 len: 1578 microversion: 2.1 time: 0.155192 Aug 11 11:16:29.416464 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 607/1230] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:16:29 2022] GET /compute/v2.1/servers/6775b84f-c318-4b37-9fdf-e93e607dfa4e => generated 1578 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:16:30.436114 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-33613fb9-82ce-4e34-b18d-34bbf31ddeb2 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:16:30.436718 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-33613fb9-82ce-4e34-b18d-34bbf31ddeb2 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: 6775b84f-c318-4b37-9fdf-e93e607dfa4e] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:16:30.443058 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-33613fb9-82ce-4e34-b18d-34bbf31ddeb2 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:16:30.443530 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-33613fb9-82ce-4e34-b18d-34bbf31ddeb2 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:16:30.444008 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-33613fb9-82ce-4e34-b18d-34bbf31ddeb2 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:16:30.444714 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-33613fb9-82ce-4e34-b18d-34bbf31ddeb2 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:16:30.445158 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-33613fb9-82ce-4e34-b18d-34bbf31ddeb2 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:16:30.445571 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-33613fb9-82ce-4e34-b18d-34bbf31ddeb2 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:16:30.574762 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-33613fb9-82ce-4e34-b18d-34bbf31ddeb2 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9dbe3b7fdd482681b6ab94c26f4e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d394882f294c6283721bcc6f8ff04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:16:30.582224 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-33613fb9-82ce-4e34-b18d-34bbf31ddeb2 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "GET /compute/v2.1/servers/6775b84f-c318-4b37-9fdf-e93e607dfa4e" status: 200 len: 1578 microversion: 2.1 time: 0.149959 Aug 11 11:16:30.582788 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 624/1231] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:16:30 2022] GET /compute/v2.1/servers/6775b84f-c318-4b37-9fdf-e93e607dfa4e => generated 1578 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:16:31.603240 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-6e98f094-5e59-43f6-b5c2-bc5a5619cdc5 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:16:31.603885 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-6e98f094-5e59-43f6-b5c2-bc5a5619cdc5 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: 6775b84f-c318-4b37-9fdf-e93e607dfa4e] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:16:31.610312 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6e98f094-5e59-43f6-b5c2-bc5a5619cdc5 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:16:31.610794 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6e98f094-5e59-43f6-b5c2-bc5a5619cdc5 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:16:31.611238 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6e98f094-5e59-43f6-b5c2-bc5a5619cdc5 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:16:31.611957 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6e98f094-5e59-43f6-b5c2-bc5a5619cdc5 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:16:31.612412 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6e98f094-5e59-43f6-b5c2-bc5a5619cdc5 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:16:31.612855 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-6e98f094-5e59-43f6-b5c2-bc5a5619cdc5 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:16:31.742110 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.policy [None req-6e98f094-5e59-43f6-b5c2-bc5a5619cdc5 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9dbe3b7fdd482681b6ab94c26f4e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d394882f294c6283721bcc6f8ff04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121231) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:16:31.750350 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-6e98f094-5e59-43f6-b5c2-bc5a5619cdc5 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "GET /compute/v2.1/servers/6775b84f-c318-4b37-9fdf-e93e607dfa4e" status: 200 len: 1578 microversion: 2.1 time: 0.150923 Aug 11 11:16:31.754365 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 608/1232] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:16:31 2022] GET /compute/v2.1/servers/6775b84f-c318-4b37-9fdf-e93e607dfa4e => generated 1578 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:16:32.772771 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-a88409f6-c058-4673-8f8c-91a594def025 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:16:32.773441 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-a88409f6-c058-4673-8f8c-91a594def025 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: 6775b84f-c318-4b37-9fdf-e93e607dfa4e] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:16:32.779998 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a88409f6-c058-4673-8f8c-91a594def025 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:16:32.780539 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a88409f6-c058-4673-8f8c-91a594def025 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:16:32.780970 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a88409f6-c058-4673-8f8c-91a594def025 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:16:32.781658 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a88409f6-c058-4673-8f8c-91a594def025 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:16:32.782131 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a88409f6-c058-4673-8f8c-91a594def025 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:16:32.782544 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-a88409f6-c058-4673-8f8c-91a594def025 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:16:32.917690 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-a88409f6-c058-4673-8f8c-91a594def025 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9dbe3b7fdd482681b6ab94c26f4e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d394882f294c6283721bcc6f8ff04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:16:32.925300 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-a88409f6-c058-4673-8f8c-91a594def025 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "GET /compute/v2.1/servers/6775b84f-c318-4b37-9fdf-e93e607dfa4e" status: 200 len: 1459 microversion: 2.1 time: 0.156966 Aug 11 11:16:32.925881 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 625/1233] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:16:32 2022] GET /compute/v2.1/servers/6775b84f-c318-4b37-9fdf-e93e607dfa4e => generated 1459 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:16:33.079142 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [req-2a48060f-761a-4f56-8ffb-68ada48632a4 req-383ae33e-50c3-4d17-aba1-d12191ba14eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6775b84f-c318-4b37-9fdf-e93e607dfa4e", "name": "network-vif-deleted", "tag": "05193d12-2729-4079-9c68-2950747232ad"}]} {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 11:16:33.088930 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-2a48060f-761a-4f56-8ffb-68ada48632a4 req-383ae33e-50c3-4d17-aba1-d12191ba14eb service nova] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:16:33.089397 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-2a48060f-761a-4f56-8ffb-68ada48632a4 req-383ae33e-50c3-4d17-aba1-d12191ba14eb service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:16:33.089825 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [req-2a48060f-761a-4f56-8ffb-68ada48632a4 req-383ae33e-50c3-4d17-aba1-d12191ba14eb service nova] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:16:33.101000 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.compute.server_external_events [req-2a48060f-761a-4f56-8ffb-68ada48632a4 req-383ae33e-50c3-4d17-aba1-d12191ba14eb service nova] Creating event network-vif-deleted:05193d12-2729-4079-9c68-2950747232ad for instance 6775b84f-c318-4b37-9fdf-e93e607dfa4e on hv-cinder-82002 Aug 11 11:16:33.106737 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [req-2a48060f-761a-4f56-8ffb-68ada48632a4 req-383ae33e-50c3-4d17-aba1-d12191ba14eb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031191 Aug 11 11:16:33.107327 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 609/1234] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Aug 11 11:16:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 11:16:33.947253 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-b62c734c-9272-44a5-a578-fcb7df3484f9 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:16:33.947253 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-b62c734c-9272-44a5-a578-fcb7df3484f9 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: 6775b84f-c318-4b37-9fdf-e93e607dfa4e] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:16:33.953651 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b62c734c-9272-44a5-a578-fcb7df3484f9 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:16:33.954131 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b62c734c-9272-44a5-a578-fcb7df3484f9 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:16:33.954563 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b62c734c-9272-44a5-a578-fcb7df3484f9 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:16:33.955250 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b62c734c-9272-44a5-a578-fcb7df3484f9 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:16:33.955700 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b62c734c-9272-44a5-a578-fcb7df3484f9 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:16:33.956153 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b62c734c-9272-44a5-a578-fcb7df3484f9 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:16:33.987585 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b62c734c-9272-44a5-a578-fcb7df3484f9 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:16:33.988124 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b62c734c-9272-44a5-a578-fcb7df3484f9 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:16:33.988564 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-b62c734c-9272-44a5-a578-fcb7df3484f9 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:16:33.989006 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.objects.instance [None req-b62c734c-9272-44a5-a578-fcb7df3484f9 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lazy-loading 'fault' on Instance uuid 6775b84f-c318-4b37-9fdf-e93e607dfa4e {{(pid=121232) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 11:16:34.035080 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.policy [None req-b62c734c-9272-44a5-a578-fcb7df3484f9 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a9dbe3b7fdd482681b6ab94c26f4e71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1d394882f294c6283721bcc6f8ff04d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121232) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 11:16:34.043349 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-b62c734c-9272-44a5-a578-fcb7df3484f9 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "GET /compute/v2.1/servers/6775b84f-c318-4b37-9fdf-e93e607dfa4e" status: 200 len: 1230 microversion: 2.1 time: 0.100769 Aug 11 11:16:34.043931 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 626/1235] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:16:33 2022] GET /compute/v2.1/servers/6775b84f-c318-4b37-9fdf-e93e607dfa4e => generated 1230 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 11:16:35.065373 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-2ef1251a-3a8f-47a1-96ff-9b28590a07e4 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:16:35.066062 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-2ef1251a-3a8f-47a1-96ff-9b28590a07e4 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: 6775b84f-c318-4b37-9fdf-e93e607dfa4e] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:16:35.072668 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2ef1251a-3a8f-47a1-96ff-9b28590a07e4 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:16:35.073792 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2ef1251a-3a8f-47a1-96ff-9b28590a07e4 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:16:35.074228 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2ef1251a-3a8f-47a1-96ff-9b28590a07e4 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:16:35.074906 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2ef1251a-3a8f-47a1-96ff-9b28590a07e4 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:16:35.075352 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2ef1251a-3a8f-47a1-96ff-9b28590a07e4 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:16:35.075790 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-2ef1251a-3a8f-47a1-96ff-9b28590a07e4 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:16:35.088728 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.wsgi [None req-2ef1251a-3a8f-47a1-96ff-9b28590a07e4 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] HTTP exception thrown: Instance 6775b84f-c318-4b37-9fdf-e93e607dfa4e could not be found. Aug 11 11:16:35.090299 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-2ef1251a-3a8f-47a1-96ff-9b28590a07e4 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Request method failure captured: Aug 11 11:16:35.090299 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: request: GET /compute/v2.1/servers/6775b84f-c318-4b37-9fdf-e93e607dfa4e HTTP/1.1 Aug 11 11:16:35.090299 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Accept: application/json Aug 11 11:16:35.090299 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Accept-Encoding: identity Aug 11 11:16:35.090299 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Connection: close Aug 11 11:16:35.090299 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Content-Length: 0 Aug 11 11:16:35.090299 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Content-Type: application/json Aug 11 11:16:35.090299 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Host: 10.222.0.48 Aug 11 11:16:35.090299 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Openstack-System-Scope: None Aug 11 11:16:35.090299 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: User-Agent: python-urllib3/1.26.11 Aug 11 11:16:35.090299 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Auth-Token: gAAAAABi9ONDFF-ves-CEGtHwEi0XWUKyyde7tb-EmhLfOVMkLk-S6BaYvZIZyro-ToFwRU2ksjzyOGpMhm8jPNnMcZc2yErCXhJsj5bK4F2r0o8vxP0k2UPPpT-E6--5k2jWa36MkdUrOHa4cUapXKrNjZGlMmImRY0M-OdlgiV64MA5NWcgec Aug 11 11:16:35.090299 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Domain-Id: None Aug 11 11:16:35.090299 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Domain-Name: None Aug 11 11:16:35.090299 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Identity-Status: Confirmed Aug 11 11:16:35.090299 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Is-Admin-Project: True Aug 11 11:16:35.090299 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Domain-Id: default Aug 11 11:16:35.090299 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Domain-Name: Default Aug 11 11:16:35.090299 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Id: b1d394882f294c6283721bcc6f8ff04d Aug 11 11:16:35.090299 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Name: tempest-TestVolumeBootPattern-469230006 Aug 11 11:16:35.090299 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Role: reader,member Aug 11 11:16:35.090299 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Roles: reader,member Aug 11 11:16:35.092037 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b1d394882f294c6283721bcc6f8ff04d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b1d394882f294c6283721bcc6f8ff04d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b1d394882f294c6283721bcc6f8ff04d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b1d394882f294c6283721bcc6f8ff04d", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] Aug 11 11:16:35.092037 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant: tempest-TestVolumeBootPattern-469230006 Aug 11 11:16:35.092037 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant-Id: b1d394882f294c6283721bcc6f8ff04d Aug 11 11:16:35.092037 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant-Name: tempest-TestVolumeBootPattern-469230006 Aug 11 11:16:35.092037 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User: tempest-TestVolumeBootPattern-469230006-project Aug 11 11:16:35.092037 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Domain-Id: default Aug 11 11:16:35.092037 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Domain-Name: Default Aug 11 11:16:35.092037 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Id: 2a9dbe3b7fdd482681b6ab94c26f4e71 Aug 11 11:16:35.092037 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Name: tempest-TestVolumeBootPattern-469230006-project Aug 11 11:16:35.092037 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: method: > Aug 11 11:16:35.092037 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: exception: Instance 6775b84f-c318-4b37-9fdf-e93e607dfa4e could not be found. Aug 11 11:16:35.092037 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: action_args: {'id': '6775b84f-c318-4b37-9fdf-e93e607dfa4e'} Aug 11 11:16:35.093031 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 11:16:35.093031 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:16:35.093031 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 11:16:35.093031 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 11:16:35.093031 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 11:16:35.093031 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 11:16:35.093031 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 11:16:35.093031 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 11:16:35.093031 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 11:16:35.093031 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 11:16:35.093031 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6775b84f-c318-4b37-9fdf-e93e607dfa4e could not be found. Aug 11 11:16:35.093031 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:16:35.093031 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:16:35.093031 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:16:35.093031 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:16:35.093031 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:16:35.093031 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:16:35.093031 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 11:16:35.093031 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 11:16:35.093031 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 11:16:35.094555 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 11:16:35.094555 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 11:16:35.094555 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 11:16:35.094555 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 11:16:35.094555 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 11:16:35.094555 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 11:16:35.094555 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 11:16:35.094555 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6775b84f-c318-4b37-9fdf-e93e607dfa4e could not be found. Aug 11 11:16:35.094555 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:16:35.094555 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:16:35.094555 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:16:35.094555 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:16:35.094555 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:16:35.094555 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:16:35.094555 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 11:16:35.094555 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 11:16:35.094555 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6775b84f-c318-4b37-9fdf-e93e607dfa4e could not be found. Aug 11 11:16:35.094555 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:16:35.095932 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-2ef1251a-3a8f-47a1-96ff-9b28590a07e4 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Returning 404 to user: Instance 6775b84f-c318-4b37-9fdf-e93e607dfa4e could not be found. {{(pid=121231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 11:16:35.095932 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-2ef1251a-3a8f-47a1-96ff-9b28590a07e4 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "GET /compute/v2.1/servers/6775b84f-c318-4b37-9fdf-e93e607dfa4e" status: 404 len: 111 microversion: 2.1 time: 0.030569 Aug 11 11:16:35.095932 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 610/1236] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:16:35 2022] GET /compute/v2.1/servers/6775b84f-c318-4b37-9fdf-e93e607dfa4e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 11 11:16:35.576215 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-89703b55-d38a-4fe1-aa53-9253b57ab2d1 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Calling method '>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:16:35.576810 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.compute.api [None req-89703b55-d38a-4fe1-aa53-9253b57ab2d1 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: d1cc9961-0393-433e-9c87-cdd2b8457a85] Fetching instance by UUID {{(pid=121232) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:16:35.583277 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-89703b55-d38a-4fe1-aa53-9253b57ab2d1 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:16:35.583788 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-89703b55-d38a-4fe1-aa53-9253b57ab2d1 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:16:35.584230 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-89703b55-d38a-4fe1-aa53-9253b57ab2d1 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:16:35.584918 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-89703b55-d38a-4fe1-aa53-9253b57ab2d1 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:16:35.585374 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-89703b55-d38a-4fe1-aa53-9253b57ab2d1 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:16:35.585798 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG oslo_concurrency.lockutils [None req-89703b55-d38a-4fe1-aa53-9253b57ab2d1 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121232) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:16:35.602742 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.wsgi [None req-89703b55-d38a-4fe1-aa53-9253b57ab2d1 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] HTTP exception thrown: Instance d1cc9961-0393-433e-9c87-cdd2b8457a85 could not be found. Aug 11 11:16:35.605085 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-89703b55-d38a-4fe1-aa53-9253b57ab2d1 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Request method failure captured: Aug 11 11:16:35.605085 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: request: DELETE /compute/v2.1/servers/d1cc9961-0393-433e-9c87-cdd2b8457a85 HTTP/1.1 Aug 11 11:16:35.605085 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Accept: application/json Aug 11 11:16:35.605085 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Accept-Encoding: identity Aug 11 11:16:35.605085 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Connection: close Aug 11 11:16:35.605085 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Content-Length: 0 Aug 11 11:16:35.605085 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Content-Type: application/json Aug 11 11:16:35.605085 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Host: 10.222.0.48 Aug 11 11:16:35.605085 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Openstack-System-Scope: None Aug 11 11:16:35.605085 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: User-Agent: python-urllib3/1.26.11 Aug 11 11:16:35.605085 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Auth-Token: gAAAAABi9ONDFF-ves-CEGtHwEi0XWUKyyde7tb-EmhLfOVMkLk-S6BaYvZIZyro-ToFwRU2ksjzyOGpMhm8jPNnMcZc2yErCXhJsj5bK4F2r0o8vxP0k2UPPpT-E6--5k2jWa36MkdUrOHa4cUapXKrNjZGlMmImRY0M-OdlgiV64MA5NWcgec Aug 11 11:16:35.605085 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Domain-Id: None Aug 11 11:16:35.605085 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Domain-Name: None Aug 11 11:16:35.605085 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Identity-Status: Confirmed Aug 11 11:16:35.605085 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Is-Admin-Project: True Aug 11 11:16:35.605085 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Domain-Id: default Aug 11 11:16:35.605085 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Domain-Name: Default Aug 11 11:16:35.605085 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Id: b1d394882f294c6283721bcc6f8ff04d Aug 11 11:16:35.605085 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Project-Name: tempest-TestVolumeBootPattern-469230006 Aug 11 11:16:35.605085 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Role: reader,member Aug 11 11:16:35.605085 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Roles: reader,member Aug 11 11:16:35.606975 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b1d394882f294c6283721bcc6f8ff04d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b1d394882f294c6283721bcc6f8ff04d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b1d394882f294c6283721bcc6f8ff04d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b1d394882f294c6283721bcc6f8ff04d", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] Aug 11 11:16:35.606975 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Tenant: tempest-TestVolumeBootPattern-469230006 Aug 11 11:16:35.606975 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Tenant-Id: b1d394882f294c6283721bcc6f8ff04d Aug 11 11:16:35.606975 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-Tenant-Name: tempest-TestVolumeBootPattern-469230006 Aug 11 11:16:35.606975 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User: tempest-TestVolumeBootPattern-469230006-project Aug 11 11:16:35.606975 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Domain-Id: default Aug 11 11:16:35.606975 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Domain-Name: Default Aug 11 11:16:35.606975 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Id: 2a9dbe3b7fdd482681b6ab94c26f4e71 Aug 11 11:16:35.606975 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: X-User-Name: tempest-TestVolumeBootPattern-469230006-project Aug 11 11:16:35.606975 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: method: > Aug 11 11:16:35.606975 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: exception: Instance d1cc9961-0393-433e-9c87-cdd2b8457a85 could not be found. Aug 11 11:16:35.606975 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: action_args: {'id': 'd1cc9961-0393-433e-9c87-cdd2b8457a85'} Aug 11 11:16:35.611087 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 11:16:35.611087 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:16:35.611087 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 11:16:35.611087 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 11:16:35.611087 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 11:16:35.611087 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 11:16:35.611087 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 11:16:35.611087 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 11:16:35.611087 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 11:16:35.611087 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 11:16:35.611087 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1cc9961-0393-433e-9c87-cdd2b8457a85 could not be found. Aug 11 11:16:35.611087 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:16:35.611087 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:16:35.611087 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:16:35.611087 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:16:35.611087 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:16:35.611087 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:16:35.611087 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 11:16:35.611087 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 11:16:35.611087 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 11:16:35.612844 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 11:16:35.612844 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 11 11:16:35.612844 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 11 11:16:35.612844 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 11 11:16:35.612844 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 11 11:16:35.612844 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 11:16:35.612844 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 11:16:35.612844 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 11:16:35.612844 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 11:16:35.612844 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1cc9961-0393-433e-9c87-cdd2b8457a85 could not be found. Aug 11 11:16:35.612844 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:16:35.612844 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:16:35.612844 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:16:35.612844 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:16:35.612844 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:16:35.612844 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:16:35.612844 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 11:16:35.612844 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 11:16:35.612844 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1cc9961-0393-433e-9c87-cdd2b8457a85 could not be found. Aug 11 11:16:35.612844 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: ERROR nova.api.openstack.wsgi Aug 11 11:16:35.614513 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-89703b55-d38a-4fe1-aa53-9253b57ab2d1 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Returning 404 to user: Instance d1cc9961-0393-433e-9c87-cdd2b8457a85 could not be found. {{(pid=121232) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 11:16:35.614513 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-89703b55-d38a-4fe1-aa53-9253b57ab2d1 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d1cc9961-0393-433e-9c87-cdd2b8457a85" status: 404 len: 111 microversion: 2.1 time: 0.034303 Aug 11 11:16:35.614513 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 627/1237] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Aug 11 11:16:35 2022] DELETE /compute/v2.1/servers/d1cc9961-0393-433e-9c87-cdd2b8457a85 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 11:16:35.615288 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-aea4c159-31f3-42af-943b-31b20b2b395d tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Calling method '>' {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:16:35.615932 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.compute.api [None req-aea4c159-31f3-42af-943b-31b20b2b395d tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] [instance: d1cc9961-0393-433e-9c87-cdd2b8457a85] Fetching instance by UUID {{(pid=121231) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 11:16:35.621943 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-aea4c159-31f3-42af-943b-31b20b2b395d tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:16:35.622507 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-aea4c159-31f3-42af-943b-31b20b2b395d tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:16:35.622941 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-aea4c159-31f3-42af-943b-31b20b2b395d tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:16:35.623627 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-aea4c159-31f3-42af-943b-31b20b2b395d tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Acquiring lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 11:16:35.624106 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-aea4c159-31f3-42af-943b-31b20b2b395d tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 11:16:35.624529 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG oslo_concurrency.lockutils [None req-aea4c159-31f3-42af-943b-31b20b2b395d tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Lock "61bf41a3-eb26-4ec9-bcca-fe3b5bf655a0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121231) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 11:16:35.638107 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.wsgi [None req-aea4c159-31f3-42af-943b-31b20b2b395d tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] HTTP exception thrown: Instance d1cc9961-0393-433e-9c87-cdd2b8457a85 could not be found. Aug 11 11:16:35.639637 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-aea4c159-31f3-42af-943b-31b20b2b395d tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Request method failure captured: Aug 11 11:16:35.639637 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: request: GET /compute/v2.1/servers/d1cc9961-0393-433e-9c87-cdd2b8457a85 HTTP/1.1 Aug 11 11:16:35.639637 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Accept: application/json Aug 11 11:16:35.639637 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Accept-Encoding: identity Aug 11 11:16:35.639637 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Connection: close Aug 11 11:16:35.639637 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Content-Length: 0 Aug 11 11:16:35.639637 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Content-Type: application/json Aug 11 11:16:35.639637 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Host: 10.222.0.48 Aug 11 11:16:35.639637 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Openstack-System-Scope: None Aug 11 11:16:35.639637 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: User-Agent: python-urllib3/1.26.11 Aug 11 11:16:35.639637 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Auth-Token: gAAAAABi9ONDFF-ves-CEGtHwEi0XWUKyyde7tb-EmhLfOVMkLk-S6BaYvZIZyro-ToFwRU2ksjzyOGpMhm8jPNnMcZc2yErCXhJsj5bK4F2r0o8vxP0k2UPPpT-E6--5k2jWa36MkdUrOHa4cUapXKrNjZGlMmImRY0M-OdlgiV64MA5NWcgec Aug 11 11:16:35.639637 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Domain-Id: None Aug 11 11:16:35.639637 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Domain-Name: None Aug 11 11:16:35.639637 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Identity-Status: Confirmed Aug 11 11:16:35.639637 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Is-Admin-Project: True Aug 11 11:16:35.639637 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Domain-Id: default Aug 11 11:16:35.639637 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Domain-Name: Default Aug 11 11:16:35.639637 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Id: b1d394882f294c6283721bcc6f8ff04d Aug 11 11:16:35.639637 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Project-Name: tempest-TestVolumeBootPattern-469230006 Aug 11 11:16:35.639637 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Role: reader,member Aug 11 11:16:35.639637 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Roles: reader,member Aug 11 11:16:35.641334 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b1d394882f294c6283721bcc6f8ff04d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/b1d394882f294c6283721bcc6f8ff04d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/b1d394882f294c6283721bcc6f8ff04d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:8080/v1/AUTH_b1d394882f294c6283721bcc6f8ff04d", "adminURL": "http://10.222.0.48:8080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}] Aug 11 11:16:35.641334 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant: tempest-TestVolumeBootPattern-469230006 Aug 11 11:16:35.641334 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant-Id: b1d394882f294c6283721bcc6f8ff04d Aug 11 11:16:35.641334 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-Tenant-Name: tempest-TestVolumeBootPattern-469230006 Aug 11 11:16:35.641334 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User: tempest-TestVolumeBootPattern-469230006-project Aug 11 11:16:35.641334 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Domain-Id: default Aug 11 11:16:35.641334 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Domain-Name: Default Aug 11 11:16:35.641334 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Id: 2a9dbe3b7fdd482681b6ab94c26f4e71 Aug 11 11:16:35.641334 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: X-User-Name: tempest-TestVolumeBootPattern-469230006-project Aug 11 11:16:35.641334 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: method: > Aug 11 11:16:35.641334 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: exception: Instance d1cc9961-0393-433e-9c87-cdd2b8457a85 could not be found. Aug 11 11:16:35.641334 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: action_args: {'id': 'd1cc9961-0393-433e-9c87-cdd2b8457a85'} Aug 11 11:16:35.642334 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: {{(pid=121231) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 11:16:35.642334 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:16:35.642334 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 11:16:35.642334 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 11:16:35.642334 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 11:16:35.642334 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 11:16:35.642334 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 11:16:35.642334 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 11:16:35.642334 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 11:16:35.642334 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 11:16:35.642334 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1cc9961-0393-433e-9c87-cdd2b8457a85 could not be found. Aug 11 11:16:35.642334 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:16:35.642334 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:16:35.642334 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:16:35.642334 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:16:35.642334 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:16:35.642334 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:16:35.642334 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 11:16:35.642334 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 11:16:35.642334 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 11:16:35.643691 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 11:16:35.643691 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 11:16:35.643691 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 11:16:35.643691 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 11:16:35.643691 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 11:16:35.643691 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 11:16:35.643691 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 11:16:35.643691 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1cc9961-0393-433e-9c87-cdd2b8457a85 could not be found. Aug 11 11:16:35.643691 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:16:35.643691 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 11:16:35.643691 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:16:35.643691 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 11:16:35.643691 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 11:16:35.643691 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 11:16:35.643691 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 11:16:35.643691 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 11:16:35.643691 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1cc9961-0393-433e-9c87-cdd2b8457a85 could not be found. Aug 11 11:16:35.643691 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: ERROR nova.api.openstack.wsgi Aug 11 11:16:35.652848 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: DEBUG nova.api.openstack.wsgi [None req-aea4c159-31f3-42af-943b-31b20b2b395d tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Returning 404 to user: Instance d1cc9961-0393-433e-9c87-cdd2b8457a85 could not be found. {{(pid=121231) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 11:16:35.652848 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO nova.api.openstack.requestlog [None req-aea4c159-31f3-42af-943b-31b20b2b395d tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "GET /compute/v2.1/servers/d1cc9961-0393-433e-9c87-cdd2b8457a85" status: 404 len: 111 microversion: 2.1 time: 0.029757 Aug 11 11:16:35.652848 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: [pid: 121231|app: 0|req: 611/1238] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Aug 11 11:16:35 2022] GET /compute/v2.1/servers/d1cc9961-0393-433e-9c87-cdd2b8457a85 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 11 11:16:37.163467 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: DEBUG nova.api.openstack.wsgi [None req-aa645e5c-998f-426c-8d99-ea5e0b68cc90 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] Calling method '.version_select at 0x7faab0cd8040>' {{(pid=121232) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 11:16:37.245130 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO nova.api.openstack.requestlog [None req-aa645e5c-998f-426c-8d99-ea5e0b68cc90 tempest-TestVolumeBootPattern-469230006 tempest-TestVolumeBootPattern-469230006-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-614059539" status: 202 len: 0 microversion: 2.1 time: 0.085350 Aug 11 11:16:37.245806 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: [pid: 121232|app: 0|req: 628/1239] 10.222.0.48 () {58 vars in 1260 bytes} [Thu Aug 11 11:16:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-614059539 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 11:17:18.709183 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 11:17:18.709713 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Thu Aug 11 11:17:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 11 11:18:55.288525 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 11:18:55.289172 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Thu Aug 11 11:18:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 11 11:18:56.298703 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 11:18:56.299355 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Thu Aug 11 11:18:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 11 11:19:10.846486 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 11:19:10.847215 dv-cinder-820027-17-iscsi devstack@n-api.service[121232]: Thu Aug 11 11:19:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 11 11:19:16.136600 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 11:19:16.137229 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Thu Aug 11 11:19:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 11 11:20:38.716906 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 11:20:38.717577 dv-cinder-820027-17-iscsi devstack@n-api.service[121231]: Thu Aug 11 11:20:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!